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In this review the debated rapport between thermodynamics and quan¬ 
tum mechanics is addressed in the framework of the theory of periodically- 
driven/controlled quantum-thermodynamic machines. The basic model stud¬ 
ied here is that of a two-level system (TLS), whose energy is periodically 
modulated while the system is coupled to thermal baths. When the modula¬ 
tion interval is short compared to the bath memory time, the system-bath 
correlations are affected, thereby causing cooling or heating of the TLS, 
depending on the interval. In steady state, a periodically-modulated TLS 
coupled to two distinct baths constitutes the simplest quantum heat machine 
(QHM) that may operate as either an engine or a refrigerator, depending 
on the modulation rate. We find their efficiency and power-output bounds 
and the conditions for attaining these bounds. An extension of this model to 
multilevel systems shows that the QHM power output can be boosted by the 
multilevel degeneracy. 

These results are used to scrutinize basic thermodynamic principles: (i) 
Externally-driven/modulated QHMs may attain the Carnot efficiency bound, 
but when the driving is done by a quantum device (“piston”), the efficiency 
strongly depends on its initial quantum state. Such dependence has been 
unknown thus far. (ii) The refrigeration rate effected by QHMs does not 
vanish as the temperature approaches absolute zero for certain quantized 
baths, e.g., magnons, thous challenging Nernst’s unattainability principle, (iii) 
System-bath correlations allow more work extraction under periodic control 
than that expected from the Szilard-Landauer principle, provided the period 
is in the non-Markovian domain. Thus, dynamically-controlled QHMs may 
benefit from hitherto unexploited thermodynamic resources. 


1 Introduction 

To what extent can dynamical control of open quantum systems enhance the ability to 
extract work or cooling from available thermodynamic resources? If it can, then we may 
be able to pursue new or improved quantum-thermodynamic functionalities by harnessing 
such control to our advantage. Here we review our past and present research that has 
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been dedicated to the elucidation of this issue. In what follows, we briefly summarize the 
principles of thermodynamics, discuss their applicability in the quantum domain, then 
revisit some of its tenets that may be challenged for quantum systems under dynamical 
control. 

1.1 The principles of thermodynamics for quantum systems 

The theoretical framework of thermodynamics rests on its four basic laws (('alien, 1985; 
Gemmer et al., 2010). The zeroth law allows the definition of temperature and the first 
law is that of energy conservation. Some processes may be allowed by the first law, but 
are forbidden by the second law of thermodynamics. A prime example is the flow of heat 
between cold and hot bodies. While the first law does not set any preferred direction to 
the flow, the second law requires heat to flow from the hot to the cold body. The third 
law forbids any cooling process to attain the absolute zero. 

Despite efforts to reconcile quantum mechanics and thermodynamics over the years, 
their compatibility is still an open fundamental problem, with crucial bearing on the 
validity of these thermodynamic laws and the performance bounds of heat machines 
in the quantum domain (Gemmer et al., 2010; Kosloff, 2013). A priori, it is unclear 
why these two disciplines should be related: While thermodynamics was developed 
as a theory that limits possible macroscopic processes, quantum mechanics describes 
mainly microscopic systems. Nevertheless, thermodynamic principles have played an 
essential role in the development of quantum mechanics. Planck proposed the existence of 
quanta (Planck, 1900) by employing a thermodynamic approach to explain the blackbody 
radiation spectrum. Based on thermodynamic arguments, Einstein predicted stimulated 
emission (Einstein, 1916). In the same way, a thermodynamic approach may yet provide 
new insights into the ability to exploit quantum processes in machines designed for the 
performance of work or cooling. 

1.2 Why study quantum heat machines? 

Notwithstanding the long-standing rapport of thermodynamics and quantum mechanics, 
the basic question remains open: What limits does thermodynamics set to the performance 
of quantum-mechanical devices, particularly, quantum heat machines? 

This fundamental issue has been feeding for years the lively interest in quantum ther¬ 
modynamics that has culminated in a multitude of quantum heat machine models ( bah 
et al., 2012; Alicki, 1979; Allahverdyan and Nieuwenhuizen, 2005; Blickle and Bechinger, 
2011; Van den Broeck, 2005; Van den Broeck et ai, 2012; Campisi et ai, 2011, 2009; Chen 
and Li, 2012; Cleuren et al., 2012; Esposito et al., 2012, 2009, 2010b; Ford et al., 1985; 
Ford and O’Connell, 2006; Gemmer et al., 2010; Geusic et ai, 1967; Geva, 2002; Jarzynski, 
2007; Kieu, 2004; Kosloff, 2013; Lin and Chen, 2003; Linden et ai, 2010; Martinez and 
Paz, 2013; Quan et al., 2007; Scully et al., 2011; Talkner et al., 2007; Venturelli et al., 
2013). Many of these models have reproduced the classic thermodynamic bounds, such 
as the Carnot efficiency limit. On the other hand, there has been a growing number of 
claims that those bounds can be violated at the quantum level (Abah and Lutz, 2014; 
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Boukobza and Ritsch, 2013; Correa et al., 2014; Dillenschneider and Lutz, 2009; Galve 
and Lutz, 2009; Huang et al., 2012; RoBnagel et al., 2014; Scully, 2001; Scully et at, 2003). 
These claims call for a clarification of the general principles of quantum heat machines, 
beyond specific realizations, and for the development of tools that would safeguard us 
against inconsistencies with the laws of thermodynamics. These motivations underlie the 
present study of simple dynamically-controlled quantum heat machines, their efficiency 
and power bounds. 

The theoretical study of the quantum-thermodynamic models mentioned above has 
not yet been followed by experimental demonstrations. The models for quantum ther¬ 
modynamic machines that have emerged from our research presented here (Gelbwaser- 
Klimovsky et al., 2013a, b,d; Gelbwaser-Klimovsky and Kurizki, 2014, 2015; Gelbwaser- 
Klimovsky et al., 2014; Kolar et al., 2012; Niedenzu et al., 2015) also await experimental 
verification. Such verification would not only advance the state of the art of thermo¬ 
dynamics but would also benefit the ongoing effort aimed at device miniaturization 
towards the nanoscale (Aspelmeyer et al., 2014; Blais et al., 2004; Burek et al., 2012; Cui 
and Lieber, 2001; Gudiksen et al., 2002; Hu et al., 2007; Maletinsky et al., 2012). As 
the device size approaches the nanoscale, we are necessarily confronted with quantum 
thermodynamic issues (Blicklc and Bechinger, 2011; Scully et al., 2011; Segal, 2008). 
This prompts the need for studying quantum heat machines and formulating their ther¬ 
modynamic performance limits and design principles that are acutely needed for any 
application where cooling rate, power and size constraints are very severe. Particularly, 
the miniaturization of refrigerators becomes important, in view of the growing density of 
transistors on microchips that increases heat production. These developments require 
smaller and more efficient coolers and power sources (Clark and Rumbles, 1996; Epstein 
et al., 1995; Genes et al., 2009; Linden et al., 2010; Mungan et al., 1997; Pop et al., 2006). 

The considerations outlined above underscore the need to resolve the following issues: 
(i) Is the Carnot bound on efficiency upheld in quantum heat machines? (ii) Are the 
design principles of quantum heat machines as regards work or cooling power different 
from those of their classical counterparts, especially when their operation is non-adiabatic 
(and hence far from the Carnot limit cycle)? Here we show that for the simple but 
generic models we analyze, the answer to the first question is affirmative (Secs. 3 and 4), 
but quantum-state preparation of the “piston” in the heat machine may temporarily 
cause it to outperform the standard Carnot bound, since the quantum state is an extra 
thermodynamic resource (Gelbwaser-Klimovsky and Kurizki, 2014) (Secs. 5 and 6). The 
answer to the second question is also affirmative (Secs. 3 and 4): The highly non-adiabatic 
operation of such quantum heat machines (Gelbwaser-Klimovsky et al., 2013a) may yield 
much higher power than their non-adiabatic classical-like counterparts ('leva and Kosloff, 
1992a, b). 

1.3 Quantum heat machines: Basics and outstanding issues 

At the macroscopic level, thermodynamic laws govern the exchange of work and heat, 
bounding the efficiency of heat engines and refrigerators (Callen, 1985; Kondcpudi and 
Prigogine, 1998). In standard models of such machines, work extraction or cooling are 
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based on a “working fluid” (system S) that is weakly coupled to two infinite, Markovian, 
heat baths, satisfying system-bath separability. The two heat baths are at equilibrium 
at different temperatures. The system is driven in a cyclic way by a piston (P) that 
modulates the system energy while giving or extracting work. These workhorse models 
of heat machines are used to test their compatibility with the laws of thermodynamics. 

A microscopic quantum description of a heat engine or refrigerator (Alicki et al., 2004; 
Geva and Kosloff, 1992b; Levy and Kosloff, 2012; Spohn, 1978) requires the formulation of 
thermodynamic laws within a dynamical context, wherein the working fluid is a quantum 
system, driven by an external force (field) or by quantum non-demolition (QND) energy 
measurements or phase shifts of the system, while the system is coupled to reservoirs 
(heat baths): At this level of description one may hope to derive, rather than postulate, 
the constraints and bounds imposed by thermodynamics. This amounts to the analysis 
of the following thermodynamic quantities: 

(i) The average energy of the system in state p subject to the time-dependent Hamilto¬ 
nian i?s(t) 

(Hs(t)) = E s (t) = Tr[p(i)H s (t)\, (la) 


(ii) the heat 



dt', 


and (iii) the work 

„,o«l 

are related by the first law of thermodynamics 



dt', 


(lb) 

(lc) 


dE s _ dW d Q 
dt dt dt 


In a closed cycle, the standard division of energy exchange between heat and work under 
classical (parametric) driving of the reduced state of the system, p(t), via a cyclic system 
Hamiltonian iLg(f), is (Alicki, 197! ) 


Q(t) = 

/ Tr[p(t)H s (t)]dt 

J cycle 

(3a) 

w(t) = 

<f Tr p{t)H s (t) dt. 

J cycle L J 

(3b) 


(iv) The system (von Neumann) entropy (k B denotes the Boltzmann constant) 


S(p) = —k B Tr(pln p) 


(4) 


varies partly due to heat exchange with a bath at temperature T, and partly due to the 
so-called entropy production <r(t), satisfying (Alicki, 1979) 


dS_^dQ 

dt k B T dt +a ^ 


(5) 
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The first term on the r.h.s. of Eq. (5) can be either negative or positive, corresponding 
to cooling or heating of the system, respectively. The second term is always non-negative 
according to Spohn’s theorem (Spohn, 1978), considered fundamental in the theory of 
open quantum systems (Breuer and Petruccione, 2002), i.e., 

cr(t) > 0, (6) 

expressing the monotonic evolution of the entropy relative to its equilibrium value (Lind- 
blad, 1974; Spohn, 1978). Equation (6) is commonly held to be a statement of the second 
law or the time arrow (directionality) towards entropy increase (Alicki et al., 200 1). Yet 
its validity crucially depends on the Markovian approximation (Sec. 9). 

Most of the quantum heat machine models that have been recently proposed and 
studied (Abah et al, 2012; Alicki, 1979; Alicki et al, 2004; Allahverdyan et al., 2008; 
Allahverdyan and Nieuwenhuizen, 2005; Bender et al., 2000, 2002; Blickle and Bechinger, 
2011; Van den Broeck, 2005; Campisi et al, 2011, 2009; Esposito et al., 2009; Feldmann 
et al, 1996; Feldmann and Kosloff, 2000, 2004, 2010; Ford et al., 1985; Ford and O’Connell, 
2006; Geusic et al., 1967; Gcva, 2002; Geva and Kosloff, 1992b; He et al., 2002; He and 
He, 2012; Henrich et al., 2007; Jahnke et al., 2008; Jarzynski, 2007; Kaufman et al., 
2012; Kieu, 2004; Lin and Chen, 2003; Quan et al, 2007; Rempp et al., 2007; Rezek and 
Kosloff, 2006; Scully et al, 2011; Segal, 2008; Segal and Nitzan, 2006; Talkner et al., 
2007; Thomas and Johal, 2011; Wang et al., 2009, 2013) are the quantum counterparts 
of the classical reciprocating-cycle engine. A reciprocating cycle consists of “strokes” in 
which S alternates between coupling to the “hot” and “cold” heat baths and may also be 
modulated by P. Typically, it has four strokes, as in the case of the Carnot and Otto 
cycles (see Fig. la). Both are composed of two adiabatic strokes in which the working 
medium is isolated from the environment while being driven by the piston, and two 
heat transfer strokes in which the working medium is alternately coupled to one of the 
heat baths. The latter strokes are isotherms for the Carnot cycle and isochores for the 
Otto cycle. At the macroscopic level, reciprocating models describe most of the existing 
machines. For example, a car engine performs an Otto cycle, while standard refrigerators 
execute an absorption-compression refrigerator cycle (( 'alien, 1985). 

Yet, in microscopic or nanoscopic devices, especially when they operate quantum 
mechanically, reciprocating cycles pose a serious problem: On-off switching of system-bath 
interactions and their non-adiabaticity (finite duration) may strongly affect energy and 
entropy exchange, which casts doubts on the validity of commonly discussed models that 
ignore such effects. Shortcuts to adiabaticity have been motivated by these concerns (Deng 
et al, 2013; Torrontegui et al, 2013). In any case, for nanoscale systems totally embedded 
in thermal baths, such system-bath decoupling may not be possible (Levy and Kosloff, 
2014). 

For these reasons, it is expedient to consider continuous-cycle heat machines (Alicki, 
2014; Gelbwaser-Klimovsky et al, 2013a, b; Gelbwaser-Klimovsky and Kurizki, 2014, 2015; 
Gelbwaser-Klimovsky et al, 2014; Kosloff and Levy, 2014; Levy et al, 2012; Niedenzu 
et al, 2015). In a continuous cycle there are no strokes, neither coupling nor decoupling to 
and from the baths. Instead, the working fluid S is permanently coupled to the two heat 
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Figure 1: (a) A reciprocating (Otto) cycle heat machine operates in 4 strokes: Alternating 
coupling to the hot and the cold baths, as well as alternating compression and 
decompression by the piston, (b) A continuous-cycle quantum heat machine: 
The working fluid (system S) is permanently coupled to a cold heat bath at 
inverse temperature /3 C and a hot heat bath at /?h- The piston modulates the 
system and allows for power (W) extraction or supply. 


baths while being modulated by P (see Fig. lb). These machines describe scenarios that 
are common at quantum scales. The analysis of simple continuous-cycle quantum heat 
machines is the subject of Secs. 3, 4, and 7. To appreciate the merit of continuous-cycle 
models, it is instructive to consider (Sec. 7) a gas mixture of two atomic species, one 
of which is driven by a laser which plays the role of the piston P. The driven atoms 
represent the system S. They interact through collisions with another atomic species (a 
“buffer gas”), which represents one of the baths. Concurrently, the S atoms are coupled 
to the electromagnetic vacuum (the second bath) through spontaneous emission. The 
impossibility of avoiding spontaneous emission and collisions with the buffer gas makes 
the coupling to or decoupling from the baths impossible, so that the reciprocating-cycle 
models are irrelevant in such scenarios, as opposed to continuous-cycle models. 


1.4 The Carnot and maximum-power bounds for quantum heat machines 


The importance of the reciprocating cycle stems from its ability to set a universal efficiency 
limit, known as the Carnot bound (Carnot, 1824), which applies to any work extraction 
process. Just like Kelvin’s formulation of the second law of thermodynamics, the Carnot 
bound restricts work extraction in cyclic processes involving a system (working fluid) 
and baths at different temperatures. The bound is reached only by the ideal, reversible, 
infinitely-slow Carnot cycle whose efficiency is described by the simple formula 


7?Carnot — 1 


Tc 
Th ’ 


(7) 


where T c (^ is the temperature of the cold (hot) heat bath. 

In the case of refrigerators and heat pumps (HP) the corresponding bounds are set by 
the coefficient of performance (COP) and are 


p refrigerator 
Carnot 


T c 

T h - T c 


( 8 ) 
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and 


(9) 



T h 


T h -T c 


respectively. 

The efficiency bound for a work cycle at maximum power is usually of greater practical 
interest than the Carnot efficiency, which can only be achieved in the limit of vanishing 


power. Under typical conditions (such as linear heat transfer) the efficiency at maximum 


power obeys the so-called Curzon-Ahlborn bound (Chambadal, 1957; Curzon and Ahlborn, 
1975; Esposito et ai, 2010a; Novikov, 1958; Yvon, 1955) 



( 10 ) 


However, contrary to the Carnot bound, it is not universal and may be surpassed by 
suitable designs that do not contradict any thermodynamic law (Birjukov et ai, 2008; 
Esposito et al., 2010a; Gelbwaser-Klimovsky et ai, 2013a). 

Although the Carnot bound is considered universal in certain models of quantum heat 
machines (Alicki, 1979; Alicki et ai, 2012; Davies, 1974; Lindblad, 1975; Spohn, 1978), 
it has been repeatedly contested, as mentioned in Sec. 1.2 (Boukobza and Ritsch, 2013; 
Correa et ai, 2014; Rofinagel et al., 2014; Scully, 2001; Scully et al., 2003), based on 
the assertion that there may be non-classical thermodynamic resources, e.g., quantum 
coherence (Scully et al., 2003), bath squeezing (Abah and Lutz, 2014; Correa et al., 2014; 
Galve and Lutz, 2009), or negative temperature of the bath (Dunkel and Hilbert, 2013) 
that may enhance work extraction or cooling power. But is it indeed possible to use 
quantum effects to transgress the Carnot bound? 

At least in some models of quantum heat machines, a careful thermodynamic analysis, 
which considers the cycle-initialization costs as well as their non-equilibrium dynamics, 
has shown that the resulting performance bounds are not higher than Carnot (Gelbwaser- 
Klimovsky et al., 2013b, d; Gelbwaser-Klimovsky and Kurizki, 2014; Opatrny, 2005; 
Zubairy, 2002). Yet, the thermodynamic implications of quantum effects, such as coher¬ 
ence/interference, as well as the work or cooling capacity of quantum states, are still not 
fully understood, so that such potential quantum resources must be further scrutinized. 

Here we put forward (Secs. 2, 3, and 4) a rigorous approach to continuous cycles 
in quantum heat machines: We study the steady-state dynamics of periodically-driven 
open quantum systems that are permanently coupled to heat baths. We ask: Are the 
restrictions set by thermodynamics on such continuous cycles of quantum machines the 
same as for their classical counterparts or for reciprocating-cycle quantum machines? As 
shown in Sec. 3, continuous-cycle quantum heat machines require spectrally separated 
baths and reach their maximal efficiency/COP, the Carnot bound, when modulated at a 
critical frequency (rate) yielding zero power. 

A major impediment towards finding the ultimate performance limits of quantum heat 
machines is the unresolved question: If two quantum systems exchange energy, how is 
it in general divided into work and heat? The second law of thermodynamics draws an 
essential distinction between heat and work: Work can be completely transformed into 
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heat in a cyclic process, yet the opposite is not true. While at the classical level there is a 
standard and well-established definition of work, this is not the case at the quantum level. 
In recent years there have been many different proposals for defining the work performed 
by quantum heat machines (Boukobza and Tannor, 2006; Gelbwaser-Klimovsky et al., 
2013b; Gelbwaser-Klimovsky and Kurizki, 2014; Goswami and Harbola, 2013; Horodecki 
and Oppenhcim, 2013; Schroder and Mahler, 2010; Skrzypczyk et al, 2013). Nevertheless, 
a consensus has not yet been reached. 

In order to answer the questions above, we put forward a fully quantum heat machine 
model, where the periodic driving is replaced by a quantum piston. This model differs 
from the vast majority of quantum heat machine models that have been proposed to date, 
which do not address this issue (Agarwal and Chaturvedi, 2013; Alicki, 1979; Allahverdyan 
and Nieuwenhuizen, 2005; Blickle and Bechinger, 2011; Van den Broeck, 2005; Brunner 
et al, 2014; Campisi et al, 2011, 2009; Esposito et al, 2009; Ford and O’Connell, 2006; 
Gemmer et al, 2010; Geusic et al, 1967; Geva, 2002; Kieu, 2004; Kosloff, 2013; Lin 
and Chen, 2003; Quan et al, 2007; Scully et al, 2011) as they employ classical fields 
or forces to drive the working fluid and thus may be deemed semiclassical As a result, 
their size and energy consumption may well impede overall miniaturization of the device, 
limiting potential applications and experimental realizations at the nanoscale. In analogy 
to light-matter interaction (Scully and Zubairy, 1997), where the quantization of light 
results in new effects, the same may be true for quantum thermal machines. Would the 
performance bound of a quantum heat machine be the same if the piston is considered 
to be a quantum device instead of an external classical modulation? 

As discussed in Secs. 5 and 6, the study of fully-quantized heat machines must rely on 
a physically sound definition of work and take into account the quantum nature of the 
piston. Consequently, the efficiency of fully quantized heat engines and the coefficient of 
performance (COP) of their refrigerator counterparts are shown to strongly depend on 
the initial quantum piston state, its subsequent thermalization and entropy production. 
These properties of the state, nicknamed non-passivity by us, are shown to determine 
the ability of the quantized piston to serve as a thermodynamic resource. 

1.5 The third law as absolute-zero unattainability 

Quantum refrigerators may be used to study the third law of thermodynamics in the 
quantum domain. The dynamical formulation of the third law of thermodynamics (Be 
giorno, 2003; Landsberg, 1956; Nernst, 1906), Nernst’s unattainability principle, forbids 
cooling to attain the absolute zero (T = 0) in a finite number of steps, or, more generally, 
in finite time. However, the universality of this principle has been postulated rather than 
proven. It is also debatable whether this formulation is always equivalent to Nernst’s heat 
theorem, whereby the entropy vanishes at T = 0 ( andsbcrg, 1956; Levy and Kosloff, 
2012). Does the unattainability principle also apply to quantum processes? As shown 
in Sec. 8 for a minimal model of a quantum refrigerator consisting of a qubit driven by 
7r-flips, the cooling rate of certain realistic quantized baths does not vanish as T —> 0, 
thus challenging the unattainability principle (Kolaf et al, 2012). 
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1.6 Work-information tradeoff and its Szilard-Landauer bound 

Apart from issues related to quantum heat machines, quantum thermodynamics is con¬ 
cerned with the fundamental problems of thermal equilibration and the work-information 
tradeoff. The following tenets represent the prevailing views of these problems: 

• The thermal equilibrium of a system and a bath cannot be changed by mere 
observation of the system, unless some action is taken (by a “demon”) pursuant 
to the observation (Caves, 1990; Deffner and Jarzynski, 2013; Del Rio et al., 2011; 
Jacobs, 2012; Landauer, 1961; Maruyama et al., 2009; Moore and Scully, 1986; 
Scully, 2001; Szilard, 1929; Toyabe et al., 2010). If observations are of the QND 
kind, so that they affect neither the state of the system nor that of the bath, then 
any such change may be suspected to be a violation of either the first or the second 
law, as in the case of (Allahverdyan and Nieuwenhuizen, 2005). 

• Equivalently, work cannot be performed in a closed cycle by a system coupled to a 
bath solely as a result of observations: The first law implies that observations affect 
neither the energy nor the heat exchange between the system and the bath (Alicki, 
1979). Furthermore, Kelvin’s formulation of the second law precludes the extraction 
of work in a cycle by a system that is coupled to a single bath. So does Lindblad’s 
formulation of the second law (Lindblad, 1981 ). 

• In a Szilard engine, by contrast, work extraction is obtained through specific actions 
depending on the result of the observation (Szilard, 1929). If information gathered 
by observations is commuted into work by a “demon”, this work must obey the 
Szilard-Landauer (SL) bound (Caves, 1990; Del Rio et al., 2011; Jacobs, 2012; 
Landauer, 1961; Maruyama et al., 2009; Moore and Scully, 1986; Scully, 2001; 
Toyabe et al., 2010): It must not exceed the cost incurred by the erasure (resetting) 
of the demon’s memory. If one has a d-level quantum system in a pure state, one 
can draw k^T In d work out of the heat bath. If the system is in a mixed state p 
with entropy S(p), then the amount of work that can be extracted is ( licki et al., 
2004) 

W ext = k B T In d- TS(p). (11) 

Here we follow the convention that extractable work has a positive sign for an engine. 
The function f(p) = In d — S{p)/k-Q can be viewed as the information content of 
the state. This bound is commonly construed to follow from the second law. 

Yet, our recent research (Alvarez et al., 2010; Chapin and Scully, 2008; Erez et al., 
2008; Gelbwaser-Klimovsky et al., 2013a; Gordon et al., 2009, 2010) [see also (Jahnke 
and Mahler, 2010)] indicates that the foregoing tenets do not hold if the quantum system, 
as simple as a qubit, is subject to dynamical control consisting of frequent observations 
or phase shifts, even if they do not directly affect the system. The basic requirements 
for such anomalies are that these acts of control should be shorter than all the relevant 
time scales and their intervals should be within the memory time of the bath. Namely, 
the violation of these tenets is intimately connected with the breakdown of both the 
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Markovian and the adiabatic approximations. As shown in Secs. 9 and 10, frequent 
unread measurements of a quantum system coupled to a thermal bath may yield work in 
a closed cycle from the system-bath interaction (correlation) energy, unaccounted for by 
the SL bound. Whereas work and information are related by Eq. (11) that draws upon 
Markovian assumptions, their relation is changed by effects of system-bath correlations 
within non-Markovian time intervals. Nevertheless, the basic laws of thermodynamics, in 
this case the first and second laws, remain intact despite these violations and may be 
colloquially summarized by a single tenet: “There are no free lunches” (Sec. 10). 

1.7 Main results 

The results presented in this review may be summarized as follows, according to its 
sections. 

1. A master equation is presented for an open quantum system weakly coupled to two 
heat baths and periodically modulated by an external drive, based on the Floquet 
expansion of the Lindblad generator. This master equation is the prerequisite for 
studying steady-state thermal machines that are periodically driven by external 
fields. It serves to infer the heat currents and power output of these machines that 
(by construction) satisfy the second law of thermodynamics (Sec. 2). This general 
theoretical framework is used to analyze several models, as detailed below. 

2. A two level system (TLS) that is simultaneously coupled to hot and cold baths via 
off-diagonal ( a x Pauli-operator) coupling is studied. The TLS transition frequency 
is periodically modulated by an external held. It is shown that this setup is a 
minimal model of a quantum heat machine with two operation modes (engine 
and refrigerator) that can be interchanged by varying the modulation rate. Under 
spectral separation of the two baths, this machine reaches the Carnot bound. The 
maximum efficiency at maximum power is also calculated and shown to be larger 
than the Curzon-Ahlborn efficiency (Sec. 3). 

3. These results are extended to multilevel systems with upper-state degeneracy 
(Sec. 4). This degeneracy is shown to be a power-boosting resource. Although 
coherences between degenerate levels may affect this power boost, it is primarily 
dependent on the ability of the initial state to thermalize. 

4. Work extraction and cooling are studied in a self-contained model of a TLS-based 
heat machine driven by a quantum device (quantum “piston”/“battery”). The 
standard definition of work is shown to fail in such fully-quantum setups. The 
correct extractable work (based on the notion of non-passivity), or cooling, and 
their efficiency bound are shown to crucially depend on the initial quantum state 
of the piston/battery. The operation mode of the machine (engine or refrigerator) 
and performance depend on the quantum-piston frequency and non-passivity. In 
Sec. 5 the efficiency bound of the self-contained quantum engine is shown to be 
allowed to temporarily exceed the standard Carnot bound, whereas in Sec. 6 its 
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quantum-refrigerator counterpart is shown to be able to surpass the Carnot bound 
on its coefficient of performance (COP). In both cases the compliance with the 
second law is ensured, and the extra efficiency reveals the presence of hitherto 
unknown thermodynamic resources embodied by the quantum states. 

5. Another model consists of a laser field that modulates a TLS coupled to a dephasing 
bath by the a z Pauli operator and to the electromagnetic-field (vacuum) bath by 
<7 x -coupling. The dephasing bath may be heated up or cooled down depending on 
the laser-field detuning from the TLS resonance. This model explains the cooling 
of a gas by collisional redistribution of radiation that was experimentally observed 
in (Vogl and Weitz, 2009) (Sec. 7). 

6. A minimal model of a quantum refrigerator (QR), i.e., a periodically phase-flipped 
TLS permanently coupled to a finite-capacity cold bath and to an infinite-capacity 
heat dump (hot bath), is used to investigate the cooling of the cold bath towards 
absolute zero. The cold-bath cooling rate is shown not to vanish as T —> 0 for quan¬ 
tized baths comprised of magnons in the Heisenberg spin-chain model. This result 
challenges Nernst’s third-law formulation known as the unattainability principle 
(Sec. 8). 

7. Frequent measurements can control the temperature and entropy of a quantum 
system immersed in a heat bath if performed at intervals shorter than the bath 
memory (correlation) time, i.e., within the non-Markovian time domain (Sec. 9). 
Such measurements may enable the system to do more work in a closed cycle than 
permitted by the Szilard-Landauer principle. They allow the extraction of extra 
work from the system-bath correlations, a hitherto unexploited work resource. This 
is possible even if no information is gathered or the bath is at zero temperature, 
provided the cycle is non Markovian. This resource may be the basis of quantum 
engines embedded in a bath with long memory-time (Sec. 10). 

8. Sec. 11 presents an outlook that charts anticipated developments in quantum 
thermodynamics, with a focus on possible realizations of the models discussed here. 


2 Steady-state cycles under periodic modulation 

2.1 Model 

The basic setup of a continuous quantum heat machine consists of a periodically modulated 
system (working fluid) permanently coupled to cold and hot baths in equilibrium (see 
Fig. lb). The interaction with the baths and the modulation triggers the dynamics of 
the working fluid, which eventually reaches a periodic steady state or limit cycle ( Vlicki 
et ai, 2012). The periodicity endows the machine with the ability to sustain its operation 
indefinitely. Our thermodynamic analysis of such machines rests on a dynamical approach— 
we formulate the Hamiltonian and the dynamic equations, solve them to obtain the 
evolution and calculate the key thermodynamic variables, i.e., the heat currents and 
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power at steady state, upon imposing the constraints of the first and second laws on 
these variables. 

The total Hamiltonian of such a continuous quantum heat machine reads 

H tot = H s (t)+ Y, (^sb + ^b)- (12) 

ie{h,c} 


Here 

Hs(t) = H s (t + -^0 (13) 

is the time-periodic modulated system (working-fluid) Hamiltonian and 

^SB = Sj <S> Bj (14) 

is the coupling of a working-fluid operator Sj to Bj, an operator of the jth bath. Finally, 
Hg is the free Hamiltonian of the jth bath. The form of the modulation or the couplings 
may vary from one model to another. 

The time dependence of the system Hamiltonian Hs(t) renders the derivation of the 
master equation non-trivial. In this section we derive the general equations for the 
evolution of the working-fluid density matrix p, which will be used in subsequent sections 
to infer the relevant thermodynamic properties of the machine in different scenarios. 

2.2 Floquet expansion of the Markovian (Lindblad) master equation 

In this subsection we extend the standard derivation of the Lindblad generators in the 
Markovian master equation (Breuer and Petruccione, 2002; Kryszewski and Czechowska- 
Kryszk, 2008) for the reduced density matrix of the system by allowing for its Floquet 
expansion under periodic driving (Alicki et al, 2012; Gelbwaser-Klimovsky et al., 2013a; 
Kosloff, 2013). Here we assume weak coupling between the system and the baths. The 
main steps of this derivation are summarized as follows. 

1. The system Hamiltonian is periodic in r, Hs(t) = Hs(t + r). Its associated time- 
evolution operator reads 

U(t,0) = Texp H s {s)ds S j , (15) 

where T denotes the time ordering operator. According to the Floquet theorem ( lo- 
quet, 1883), this time-evolution operator can be decomposed as U(t, 0) = P(t)e Rt , 
where P(t) is r-periodic and I? is a constant operator. From 1/(0, 0) = 1 it follows 
that P(0) = 1 and hence U(t, 0) = P(r)e RT = P(0)e Rr = e Rr due to the periodicity 
of P(t). We now identify the constant operator R with an effective Hamiltonian 
H e ff via U(t, 0) = e Rr =: e~ iHeBT l fi . This effective Hamiltonian—the average over a 
period of Hs(t )—defines quasi-energies hu & via its spectrum, 

H eS = Y huj k\k){k\. (16) 

k 
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Hence, the part of the time-evolution operator (15) associated with H e g can be 
decomposed as 

e -iH e «t/h = Y / e- iWkt \k){k\. 

k 

Likewise, the expansion of the periodic P{t) reads 

P(t) = J2 p (q)e~ iqnt , 

q£l 

with 12 := 2tt/t and 

P{q) = - I' P(t)e iqQt dt. 

T Jo 

The Fourier components of the system operator in Eq. (14) are then given in the 
interaction picture by 

S(t) = U\t, 0 )SU(t, = S qu e- i ^ +q ^ t . (20) 

q £Z {a;} 

Here {a;} is defined as the set of all transition (Bohr) frequencies uik — u>i between 
the levels of H e g- and the operators S qu} are the (/th-harmonic transition operators 
between those levels (Szczygielski et al, 201-' ). 

2. The Floquet-expanded Lindblad generator acting on the system-state p then assumes 
the following form in the interaction picture, 

^ = X] X] ^q = y. y, yi £-ijqi (21) 

qGZ {uj> 0} qGZ {u>0} j£{c,h} 

in terms of the gth-harmonic Liouvillians (Lindblad generators) associated with 
the jth bath, 

C-lqP = 7 ,Gj{uj + qU) (2S uq pSl q - SlgScjgP - pSigSuq) 

+ - q£l) (2 Si q pS wq - s uq sl q p - pSugSlg) . ( 22 ) 

Here we have defined the temperature-dependent bath response spectra 

/ oo 

e iu}t {B j {t)B j {{)))dt, (23) 

-OO 

which fulfill the detailed-balance KMS relation Gj(-uj) = e~P jnw Gj(uj) (Breuer and 
Petruccione, 2002) with the inverse temperature j 3 j = 1 /ksTj. The expansion (22) 
decomposes the effects of physical baths (labeled by j) into those of multiple 
“sub-baths” (labeled by q) which interact with the system. By virtue of the KMS 
theorem, each sub-bath Lindblad generator (22) possesses a Gibbs-like stationary 

= Z - 1 exp (-^±^p jHeS ^ . (24) 


(17) 

(18) 

(19) 
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As an example, for a modulated qubit energy hco o + hu(t), the operators S qu correspond 
to the phase-modulated Pauli raising and lowering operators according to (Alicki, 2014; 
Alicki et al. , 2012) 


M*) = J2^ a - 


0 -i(uo+qVl)t 


q SZ 


with 


1 


£0?) '■= - J o dt'exp [ —i 


i j* w(s)dsj e iqM . 


(25) 


(26) 


The sub-bath Lindblad generators then assume the form 
£qP = 7 > P (<i) G j{u 0 + qty (‘2cr-pa+ ~ a + cr_p - pa + a _) 


+ 2 P {q) G j(-u o - qty ( 2a + pa _ - a-a + p - pcr-cr + ), (27) 
with P(q) := |£(g)| 2 being the weight of the qth. (Floquet harmonic) “sub-bath”. 


2.3 Heat currents and the first and second law 


Upon taking the time derivative of the von Neumann entropy S(p(t)) = -k B Tr [p(f) In p(t)], 
one obtains 


d_ 

dt 


S{p(t)) 


-k B Tr [p(t) in p(t)} = —k B E 


E ^ 


£lqP(t) ln P(t) 


q£Z {oj> 0} je{c,h} 


(28) 


where we have used the Liouville (master) equation p(t) = Cp(t), expansion (21), and 
Tr[p(t)] = 0. We now make use of the Spohn inequality (Spohn, 1978) 


Tr [£p(ln p — ln p ss )] < 0, 


(29) 


which is the expression of the second law for any Lindblad superoperator C and its 
stationary state p ss ( Cp ss = 0). This inequality is applied to every term of the sum in 
Eq. (28), resorting to the stationary state of D^q, p>i w , yielding 


d 


(30) 


This inequality is then compared to the dynamical version of the second law of thermo¬ 
dynamics (Gelbwaser-Klimovsky et al., 2013a; Kosloff, 2013) 

^5(p(t)) - £ LJ,(() > 0. (31) 

i i 


This comparison of Eqs. (30) and (31) allows us to identify the heat current Jj{t) 
(energy-flow rate) between the working fluid and the jth bath as (Alicki et al., 2012; 
Gelbwaser-Klimovsky et al., 2013a; Kolar et al., 2012; Kosloff, 2013) 


jjit) 


4EE Tr 

q&Z{u)> 0} 




(32) 
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For steady-state operation (the limit cycle in the Schrodinger picture), wherein the system 
is in state p ss , these heat currents simplify, upon inserting Eq. (24) into Eq. (32), to the 
following form, 


J i = E E 

q£Z{ui> 0} 


U ^ 
LO 




(33) 


Here & qu] p ss expresses the energy-flow rate exchanged with the sub-bath (j, q ) and 
oj+qn corresponds to the qth harmonic energy. The product of these two quantities is 
the energy exchanged with the respective sub-bath. 

In this steady-state regime, where transient effects have died out, the second law (31) 
adopts the form 



(34) 


According to the first law (of energy conservation), the stationary power (the time 
derivative of the work) of an external periodic force acting on the system is 


3 


(35) 


A negative sign of the power means that work is extracted from the heat machine, i.e., 
that it is operated as a heat engine. 


2.4 Coarse-grained evolution of a periodically-modulated qubit: From 
non-Markovian to Markovian dynamics 

The dynamics obtained from the Floquet-expanded Lindblad superoperator (27) can also 
be derived upon coarse-graining over a cycle (modulation period) the time-dependent 
evolution generated by a periodically-driven non-Markovian master equation (Kofman 
and Kurizki, 2004). In what follows we outline this procedure. 

We assume that the system-bath interaction is weak, which allows for the Born 
approximation wherein the system and the bath are approximately in a product state. 
Zwanzig’s projection operator technique then allows to derive the following non-Markovian 
master equation in the interaction picture for the reduced system density matrix p (Gordon 
et al., 2007, 2008; Kofman and Kurizki, 2004), 

p(t) = [ dt' (4> T (t - t') [S(f - t')p(t), S] + H.c.) , (36) 

Jo 

where 

$ T (t) = ( e iHBt/h Be- iHBt/h B^ B (37) 

is the “memory” or correlation function of the bath and the time dependence of the 
system operator S(t ) is evaluated in the interaction picture. 

For a periodically modulated qubit, the master equation (36) yields the rate equa¬ 
tions (Kofman and Kurizki, 200 ) 

Pee = Pgg = 7? e (t)p ee T Rg(t)Pgg, (^8) 
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(39a) 


where the \e) —> \g) and \g) —> \e ) transition rates are, respectively, 


Reify = 2 Re f - t') 

Jo 

Rg{t ) = 2 Re f At'e-^-^eifytit'^Tit - t'), 
Jo 

and the time-dependent phase factors are defined as 


£(*):= exp 



(39b) 


(40) 


The periodicity of the transition rates (39) at times much longer than the bath correlation 
(memory) time t c is determined by the external modulation rate Cl = 2i t/t. Owing to the 
weak coupling of the qubit to the bath, the qubit evolves much more slowly than r, so 
that the rates can be averaged (coarse-grained) as follows (Kofman and Ivurizki, 2004; 
Kolaf et. al . , 2012) 


_ l An+l)r 

R e ~ — lim / 

T Jnr 

_ 1 r{n+l)r 

Rn « - lim / 

T J nT 


R e {t)dt = \£,(q)\ 2 Gt(u o + qty 

q£l 

R g (t)dt=Y\aq)\ 2 G T (-uo-qn). 


(41a) 

(41b) 


Here the right-hand equality involves the Fourier expansion 

m = Yz(<i) e ~ iqnt ’ ( 42a ) 

q£Z 

£(q) := ^ [ At' exp (-i J* u(s)As^ e iqUt ', (42b) 


and the Fourier-transformed autocorrelation function of the bath [cf. Eq. (23)] 


/ +oo 

e^rfyAt. 

-OO 


(43) 


These time-averaged rates (41), obtained by coarse-graining the non-Markovian master 
equation (36), are identical to those derived from the Floquet-expanded Markovian master 
equation (27). 


2.5 Summary 

In this section we have derived the basic dynamic equations and thermodynamic variables 
(heat currents and power) of a QHM that we will apply to different cases in the remainder 
of this review. 

The Lindblad master equation for a periodically-driven (controlled) system interacting 
with two heat baths in the interaction picture can be decomposed into “sub-bath” 
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Figure 2: Periodically-modulated qubit coupled to hot and cold heat baths. 


contributions according to Floquet’s theorem. These “sub-bath” Lindblad operators 
describe the interaction of the periodically-modulated system with a single heat bath 
at a shifted Bohr frequency (corresponding to a harmonic Floquet sideband). The heat 
currents can likewise be decomposed into Floquet harmonics and are (by construction) 
compatible with the second law of thermodynamics. 

3 Periodically-modulated qubit-based heat machine 

3.1 Steady-state operation of a continuous-cycle single-qubit heat machine 

The Floquet decomposition of the Markovian master equation presented in Sec. 2 provides 
a general framework for the analysis of continuously-operated periodically-driven heat 
machines whose working fluid is treated quantum-mechanically. We here review a simple 
machine of this kind based on a single qubit (two-level system- TLS), in order to 
determine its efficiency or COP and compare it with reciprocating-cycle (stroke-based) 
heat machines. 

The transition energy of the working-fluid TLS is periodically modulated by an external 
field according to (see also Fig. 2) (Gelbwaser-Klimovsky et al., 2013 i) 

Hs(t) = ^hw(t)a z (44) 

with lo (t + jy^J = u(t). In this semiclassical model the driving field plays the role of a 
piston, i.e., it allows for extracting/supplying work from/to the heat machine. At the 
same time, this TLS is coupled to cold and hot heat baths via 

Hsb = °x < 8 > (-Bh + B c ), (45) 

where Bj are the respective bath operators. 

The reduced density operator for the TLS evolves according to the Floquet-expanded 
master equation [Eqs. (21) and (22)] 

P = £p=J2 C qP > ( 46 ) 

<?ez je{ c,h} 


19 









Figure 3: An example of spectrally separated baths required for high-efficiency continuous- 
cycle heat machine operation in Fig. 2: The two-level system with resonance 
frequency ujq is coupled to the cold (hot) bath at the left (right) Floquet 
sideband only. The green vertical lines indicate the coupling weights P(q) to 
these sidebands. 

with the Lindblad operators (27) derived in Sec. 2. The steady-state solution of the 
master equation (46) is diagonal, with the ratio of excited- and ground-state populations 
satisfying (Gclbwaser-Klimovsky et al., 2013 ) 

pf e _ E qJ P{q)Gj{u 0 + q Q)e-W^+^) 

* Pf g E q ,P(q)G j (co 0 + q n) ’ 1 j 

where P{q ) and G( u>o + qQ) are as in Eq. (27). According to Eqs. (32) and (33), the cold 
(c) and hot (h) heat currents between the TLS and the respective baths are then given by 

e ~Pc(h)K^o +<A2) _ w 

J c(h) = + qfyP{q)G c ( h )( u 0 + q n) -—-• (48) 

w w w + 1 

qez 

The power is given, according to Eq. (35) (the first law), by 

w _ e -0jh(u} O +qn) 

W = Y. E Ku }0 + qn)P(q)G j (u 0 + qn) -—-. (49) 

q&j£{c,h} W + 

In what follows we investigate the conditions for a negative sign of W that corresponds 
to power extraction (at expense of the hot bath), i.e, to the heat machine being operated 
as an engine, and, conversely, a positive sign of W that may yield refrigeration of the 
cold bath (at the expense of power invested by the piston). 

3.2 Periodic modulation and bath spectra 

The preceding expressions for the heat currents [Eq. (48)] and the power [Eq. (49)] 
are not easy to interpret. We therefore review special choices of the modulation form 
u(t) [Eq. (44)] as well as of the bath response spectra G c {uf) and Gh(w) discussed 
in (Gclbwaser-Klimovsky et al., 2013a). We will see that the modulation rate fl allows us 
to operate the thermodynamic machine on demand as either an engine or a refrigerator. 

The Carnot efficiency bound can be reached if only two harmonics contribute to the 
sums in Eqs. (48) and (49) (Gclbwaser-Klimovsky et al., 2013a). This requires a spectral 
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separation of the two baths, i.e., the system must only be coupled to the cold bath at a 
specific sideband cjq + q\Q and to the hot bath only at another sideband cuo + (cf. 
Fig. 3). As an example, for a sinusoidally-modulated TLS transition frequency 

ui(t) = ojq + Ksin(flf) (50) 

three harmonics (q = 0, ±1) contribute to the coupling in the weak-modulation limit 
0 <k<(], with respective weights 

^ < 5i) 

The restriction of the coupling to only two sidebands can be achieved for specially 
designed bath response spectra, e.g., 


G c (ui) ~ 0 for co « ujq ± fi, Gh(w) ~ 0 for co < coq. (52) 


For this specific choice the general equations (48) and (49) for the heat currents and the 
power are reduced to (Gelbwaser-Klimovsky et al., 2013a) 


Jh — h(oo 0 + n) 
J c = -hcoo 

w = -m 


e ~/3 h h(u) 0 +n) _ e ~/3 c hw 0 


N 


e ~PhK u o+^) _ e -~/3 c hw 0 


e ~/3 h h(uj 0 +n) _ e ~p c hw 0 


N 

N, 


(53a) 

(53b) 

(53c) 


where the normalization factor is a positive function of k, f2, the bath response spectra 
Gj(oo) and the inverse bath temperatures f3j = l/k^Tj, where k-Q is the Boltzmann 
constant. 

Equations (53) reveal the existence of a critical modulation frequency (Gelbwaser- 
Klimovsky et al., 2013a) 

n T h -T c 

O crit = w 0 ——-. (54) 

-*-C 

According to Eqs. (53) the machine acts as a heat engine (i.e., W < 0, J c < 0, Jh > 0) 
when driven below this critical frequency (fl < fl cr i t ), and its efficiency is found to be 


n 

coq t n 


(55) 


At Q = Q cr j t the efficiency attains the Carnot bound, where the power and the heat 
currents vanish, W = J c = Jh = 0. For higher modulation frequencies (fl > fi cr it) the 
signs of the heat currents and the power in Eqs. (53) are reversed, implying that the 
machine operates as a refrigerator of the cold bath, J c > 0 (at the expense of invested 
power, W > 0), with the coefficient of performance 


COP 


COo — kt 

n 


(56) 
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Figure 4: Heat currents for the QHM described by Figs. 2 and 3 as a function of the 
modulation frequency. For low modulation frequencies (below H cr j t ) the QHM 
operates as an engine (negative power W < 0) and for high frequencies (above 
H cr it) as a refrigerator (W >0). The heat currents change their signs accordingly. 
The maximum power is obtained at modulation frequency fl max . 



Figure 5: Efficiency/COP in the two operational regimes of Fig. 4 as a function of the 
modulation rate H. At H max , where the power is maximized, the efficiency 
exceeds the Curzon-Ahlborn bound. At H cr i t the zero-power Carnot bound is 
attained. 
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Figure 6: Schematic view of a quantum heat machine comprised of many TLS (e.g., 
quantum dots) sandwiched between layers of different materials characterized 
by different phonon spectra and temperatures. The inset shows the periodic 
modulation (ac Stark shift) of the TLS level distance by an off-resonant elec¬ 
tromagnetic field. 


Thus, the Carnot efficiency bound reached at fi = D cr i t cannot be surpassed (see Figs. 4 
and 5). Numerical simulations of a somewhat similar heat machine also revealed such a 
universal behavior (Birjukov et al. , 2008). 

For many applications the maximally achievable efficiency is less important than the 
heat engine’s efficiency at maximum power output. For macroscopic Carnot-type engines 
the latter is given by the Curzon-Ahlborn efficiency bound (Curzon and Ahlborn, 19T r >) 
[Eq. (10)], which, however, can be surpassed in the presented continuous-cycle heat 
machine, provided that the bath response spectra fulfill Eq. (52) (( 1 elbwaser-Klirriovsky 
et al., 2013a). 

3.3 Realization considerations 

To efficiently operate the machine described above, a necessary requirement on the bath 
coupling spectra is their separation. For hot and cold phonon baths associated with two 
different materials that have a Debye spectrum (Gelbwaser-Klimovsky et al., 2013a) 

Gj H = fj (^0 ( W D - M) > ( 57 ) 

where 0 denotes the Heaviside step function, are the Debye frequencies of the two 
baths, and fj are bath-specific functions, the desired separation can be achieved if the 
respective Debye frequencies lie in the vicinity of the material temperatures, 

- j, Md - (58) 

In this scenario, the TLS working fluid may be realized by a quantum dot sandwiched 
between two different materials (as depicted in Fig. 6). Further implementations, e.g., 
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by means of a double-well potential are discussed in (Alicki, 2014; Gelbwaser-Klimovsky 
et al., 2013a). The classical drive modulating the qubit’s resonance frequency may be 
provided by an off-resonant microwave or optical field via the ac Stark effect. 

A general way of obtaining separated bath response spectra, discussed in (Gelbwaser- 
Klimovsky et al., 2013a), consists of constructing “filter” modes through which the system 
interacts with the baths. These filter modes can be easily tuned to create the desired 
form (or effective bath spectra) without the need to directly engineer the materials’ 
autocorrelation functions. 

3.4 Summary 

The presented “minimal” realization of a continuous, periodically-driven heat machine 
based on a single qubit displays a wide range of interesting features. It can be universally 
operated, i.e., be switched on demand from an engine to a refrigerator regime by tuning 
the modulation rate. The engine’s efficiency at maximal power output can surpass the 
Curzon-Ahlborn bound at an appropriate modulation rate. The Carnot bound, however, 
remains intact as this model (by construction) adheres to the first and second laws of 
thermodynamics. When approaching the critical driving frequency from below, the engine 
reaches Carnot efficiency but at the same time the heat currents and the power output 
vanish. Any further increase of the driving held turns the engine into a refrigerator. 
Spectral separation of the two baths is essential for attaining high efficiency. 

This inherently non-adiabatic model circumvents the difficulty of breaking a finite-time 
(reciprocating) cycle into strokes: Abrupt on-off switching of system-bath interactions in 
alternating strokes of such cycles may strongly affect their energy and entropy exchange 
and thereby their quantum state, which casts doubts on the validity of existing models 
of finite-time engines that ignore such effects. 

4 Quantum heat machines based on periodically-modulated 
multilevel systems 

4.1 Introduction and model 

Having presented in Secs. 2 and 3 the universal features of periodically-driven, continuous- 
cycle, steady-state quantum heat machines, we now extend the theory from the two-level 
to the IV-level case (Gelbwaser-Klimovsky et al., 2014; Niedenzu et al., 2015). The 
main motivation for this study stems from the pioneering work that identified quantum 
coherences as a favorable asset in quantum heat engines (Scully et al., 2011, 2003). To this 
end we consider an IV-level system with a common ground state and N — 1 degenerate 
upper states (Fig. 7). We show that in such a system both the heat currents and the 
work can be strongly enhanced with respect to a single two-level system (TLS) by means 
of bath-mediated dipolar couplings between different transitions. However, the efficiency 
(in the case of an engine) or the COP (in the case of a refrigerator) remain the same as 
for their two-level counterparts. 
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Figure 7: A degenerate multilevel QHM: An IV-level system permanently coupled to a cold 
(dashed blue arrows) and a hot (solid red arrows) heat bath. The degenerate 
upper states are periodically modulated by an external field. 


As in the TLS case, the upper states are assumed to be periodically modulated (by 
uncoupling modulation as in the two-level case) according to 

, N -1 

H s{t) = -h[u o + w(i)] J2 a h ( 59 ) 

3 =1 

where oj{t+jf) = oj(t), the modulation rate fl being as in Eq. (44) and a\ := — 10)(0|. 

Assuming dipole coupling of the system to the baths, the Floquet-expanded master 
equation becomes the following generalization of Eq. (27) (Gelbwaser-Klimovsky et ai, 
2014; Niedenzu et al. , 2015), 

p = J2 J2 C iP » ( 60a ) 

gGZ i={c,h} 

in terms of the “sub-bath” Liouvillians 
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, (60b) 


where we have used the definition T>(a,b) := 2 apb — bap — pba of the dissipator. The 
rates of the absorption and emission processes in (60b) are determined by the Floquet 
coefficients P(q) for the gth harmonic sideband, the bath temperatures /% = 1 /k^Ti 
and the bath response spectra. For simplicity we have here assumed real and equally 
strong dipoles [the general case is analyzed in (Niedenzu et ai, 2014)]. The geometrical 
configuration of the N — 1 dipole-transition vectors is described by the (Hermitian) 
dipole-alignment matrix 

Pij ■= = cos Z(dj, dj). (61) 

I ^ i I I I 

The “sub-bath” Liouvillians in Eq. (60b) have a clear physical interpretation: Emission 
and absorption processes involving a single transition are represented by the terms 
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T> (&-, (Tj^j and V cr?_) • These terms also describe effective population transfer be¬ 
tween the different excited states via the common ground state. The remaining dissipators 
V , a^ + and T> [a ^ + , ai_ are cross-correlations between the transitions that create 
time-dependent coherences and population transfer among the excited states. These 
bath-mediated correlated interactions between two excited states are largest if their 
corresponding dipole-transition vectors d j and dj/ are aligned (p jy = 1 ) and vanish for 
orthogonal transitions (p jy = 0). However, even for orthogonal transitions, the existence 
of a common ground state is expected to give rise to correlations between populations of 
different excited states, but not to coherences between them. Namely, even in the latter 
case the presence of multiple excited states will affect the steady-state populations. 

4.2 Steady-state solution 

The steady-state solution of the master equation (60a) strongly depends on the relative 
orientations of the transition dipoles. For the sake of clarity we first present the result 
for a three-level system. The system dynamics is then strongly influenced by the relative 
orientation of the two dipole-transition vectors. For non-aligned dipoles (p 7 ^ 1), the 
three-level system thermalizes with the baths with an effective temperature (Gelbwaser- 
Ivlimovsky et al , 2014; Niedenzu et al. , 2015), 

ss _ ss _ p -/3 eS hw Q ss 

P 11 — P 22 — e mu 

where the effective temperature is defined by the Boltzmann factor 

e -p eB hw 0 S g ez Z)jg{c,h} P{q)Gj{-uJo - qfl) 

X)ie{c,h} P{q)Gi(u 0 + qQ) 

The steady-state solution (62) is thermalized (diagonal) and does not contain any 
coherences (off-diagonal matrix elements). 

For aligned dipoles, however, the steady-state solution drastically changes. One can show 
that the system-bath coupling Hamiltonian [and thus the master equation (60a)] possesses 
a dark state \ipd) (a linear combination of the excited states) (Gelbwaser-Klimovsky et al, 
2014; Niedenzu et al, 2015), which does not interact with the environment. Consequently, 
this state is removed from the dynamics and the three-level system behaves as a two-level 
system with an enhanced transition-dipole strength. This effective TLS is formed by the 
ground state and a “bright” state |"0b) (orthogonal to the dark state). As the overlap of the 
initial state with this dark state is a constant of motion, it is clear that the steady-state 
solution depends on their overlap. Accordingly, we find (Gelbwaser-Klimovsky et al, 
2014; Niedenzu et al, 2015) 

P *i = 1 + e Lw, [1 - Am{ 0)] ^ (64a) 

Pdd = (V’dlp(O)IV’d) • (64b) 

This is a (diagonal) partially thermalized state characterized by its thermalization capability 
[1 — Pdd(0)]. This steady-state solution (64) is only diagonal in the basis formed by the 


(62) 

(63) 
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dark, the bright, and the ground states. When it is transformed back to the “bare” basis 
of states |1) and 12), coherences between the excited states are revealed. 

The solution can be generalized to N — 1 excited states. The number of different dipole 
directions n then determines the dimensionality !V e g < IV of an effective multilevel system 
(-/V e ff = n + 1). The steady-state solution of the master equation (60a) is a partially 
thermalized state [like Eq. (64)] for this iV e fj-level system, where the N e s — 1 upper 
states and the ground state |0) thermalize with the two baths to the effective inverse 
temperature /3 e ff (Niedenzu et al. , 2015), 


Poo = 


1 + (N eS - l) e -A=ff^o 


0 ss _ e -/3 eS nw 0 ^ 


Pii = e "“-“PSo for i = 1 


i (n<i)p(o) 

■ ■ ■ , Neff — 1 . 


(65a) 

(65b) 


Here the projector (n^) measures the system’s initial overlap with the multidimensional 
dark subspace, which is excluded from the thermalization capability. The remaining 
diagonal elements correspond to these dark states. 


4.3 Heat currents and power 

The heat currents and the power associated to the steady-state solution (65) can be 
derived from the general formulae (32) and (35). The resulting expressions are quite 
cumbersome, but can be simplified when comparing them to their TLS counterparts from 
Sec. 3, which yields 


Ji 


J7 hS 
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w TLS 


(IV-1) i — (n d )p (0) 


\ _|_ g — Peff^O 

1 + (-/V e ff - l) e -Arff^0 ’ 


( 66 ) 


The first factor on the r.h.s. describes the enhancement of the heat currents and the power 
that stems from the multiple thermalization pathways , i.e., the number of transitions 
compared to a single TLS. The second factor is the thermalization capability that 
measures to what extent the initial state undergoes thermalization. This factor differs 
from unity if two or more transition-dipole vectors are parallel. The last factor depends 
on the modulation type, the baths’ temperatures and their response spectra through 
the effective temperature /5 e ff- A special case is N e s = 2, i.e., a TLS or an iV-level 
system whose transitions are all parallel: The effective-temperature-dependent factor 
then becomes unity. Further insight into Eq. (66) can be obtained from the equivalent 
form (Gelbwaser-Klimovsky et al., 2014; Niedenzu et al., 2015) 


Ji _ W 

JTLS “ WTLS 


(IV-1) 


Poo 

„ TL S- 

Poo 


(67) 


Hence, the steady-state ground-state population determines the power enhancement. 

Another important consequence of Eq. (67) concerns the efficiency r] = — W/ (when 
operating as an engine) or the COP = J c /W (for a refrigerator). The currents and the 
power are equally modified with respect to a TLS, so that these figures of merit are 
not altered: A multilevel quantum heat engine performs as efficiently as its two-level 
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Figure 8 : Power enhancement for a working fluid realized by an 11-level system relative 
to its two-level counterpart in the QHM of Fig. 7 assuming optimal power 
enhancement conditions (no initial overlap with dark states). The three curves 
represent (i) no parallel dipoles (N e g- = N = 11), (ii) some parallel dipoles 
(IVeff = 5), and (iii) all dipoles being parallel (N e s = 2). 


counterpart. Notably, the Carnot bound is adhered to (Gelbwaser-Klimovsky et al . , 
2011 ), as the heat currents by definition obey the second law. 

To better understand how the dipole alignment affects the power enhancement factor, let 
us assume an initial state amenable to full thermalization (i.e., no dark-state population), 
e.g., p(0) = |0)(0|. As shown in Fig. 8 , in the low-temperature regime (/ 3 e shuJo 1), 
the enhancement is the same for any alignment. This behavior can be understood from 
Eqs. (67) and (65): At such temperatures the ground-state population in steady state, 
Pooj is very close to unity and is independent of N e g, i.e., the number of available levels. 
Therefore, the heat currents and the power are both enhanced by a factor of N — 1. In the 
high-temperature regime ( f3 e fihuJo <C 1 ), however, a difference is expected between aligned 
and non-aligned configurations due to the last factor in Eq. ( 66 ). At such temperatures, 
e -Peff^o ~ i anc i ( 05 ) corresponds to an equipartition amongst all available states. 
The fewer levels are available, the more will the ground state be populated. Therefore, 
systems with more parallel dipole transitions (and hence fewer available states) are 
favorable compared to the entirely non-aligned system. If all dipoles are parallel, the 
A-level system corresponds to a single two-level system with an enhanced dipole moment. 
The power boost is then independent of the modulation type, bath temperatures or bath 
spectra. 

The steady-state solution (65) is diagonal in the basis spanned by bright and dark 
states. In the bare-state basis, however, this diagonality may be lost and coherences 
within the excited-state manifold appear, if at least two dipoles are parallel. However, the 
criteria for enhanced power extraction (and thermalization capability) are obscure in that 
basis. In particular, it is impossible to attribute power enhancement neither to the mere 
presence of coherences, nor to their magnitude Ipfjl, P ss being the steady-state 

density matrix in the bare-state basis: It is clear from Eq. (65) that the largest amount 
of steady-state coherences corresponds to a dark initial state—and hence to zero power. 
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Only such an initial condition corresponds to a population-inverted steady state, as in all 
other cases the ground state is populated via emission into the bath [Eq. (65a)]. On the 
other hand, if the ground state is populated, the possible amount of coherences between 
the excited states, |pf||, is inevitably reduced. 

4.4 Summary 

Excited-states degeneracy of the working fluid is a resource in a periodically-driven steady- 
state quantum heat machine, in the sense that it can boost heat currents and power 
compared to its two-level counterpart. The maximal power enhancement factor for equally 
strong transition dipoles is N — 1. Yet, the efficiency or the coefficient of performance 
(depending on the operational regime) remains unchanged. The key factor determining 
the power enhancement is the steady-state ground-state population , regardless of the 
dipole orientation. If there are at least two parallel transition dipoles, the thermalization 
capability of the initial state becomes important: Initial states that do not fully thermalize 
reduce the heat currents to the two baths and the generated power. 

5 Quantum heat engines driven by a quantum piston 

5.1 Introduction and motivation 

As part of our endeavor to reconcile quantum mechanics and thermodynamics, we have 
introduced in the preceding sections simple models of quantum heat machines and 
analyzed their compliance with thermodynamic laws. However, these heat machines are 
not fully quantum-mechanical but rather semiclassical, since their modulation or drive 
(the piston) is generated by an external classical field. 

The quest for a fully quantum heat machine brings out interesting results as well as 
challenges. As we show below, a new definition of work is required, which allows us to 
study the thermodynamic nature of different quantum states and classify them according 
to their contribution to power extraction and cooling. 

5.2 Work in fully quantized setups 

The introduction of a quantum piston instead of an external modulation (sketched in 
Fig. 9) requires a fundamental change in the total Hamiltonian [Eq. (12)] we have used. 
For a fully quantized heat machine the total Hamiltonian is 

Htot = Hs + Hp + H$p + ^ (Hb + -^sb ) • (68) 

j=c,h 

Here the system (working fluid) Hamiltonian H$ no longer depends on time and the 
Hamiltonian contains two additional terms: The (free) Hamiltonian of the piston, Hp, 
and the interaction Hamiltonian between the working fluid, S, and the piston, H$p. 

In semiclassical models (see Sec. 2), the first law was used to define the power [Eq. (35)], 
implying that all the energy interchanged with the external field is considered to be 
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Figure 9: The semiclassical driving field (left) in the model of Fig. 2 is replaced in a 
fully-quantized heat machine by an additional quantum system—the quantized 
piston (right). 


work. If the piston is quantized, it may seem natural to do the same, i.e., to identify any 
increase of its energy with work. However, this may lead to contradictions with the second 
law of thermodynamics. As an example, suppose that a piston is initially in a thermal 
state, and remains there through its evolution, but with an increasing temperature. The 
piston gains energy, but this energy cannot be considered work: This can be proven by 
coupling only one hot bath to the working fluid, which will increase the piston’s energy. 
But if this energy is considered to be work, we may be able to extract work from a single 
bath, in clear violation of the second law of thermodynamics. This shows the need for 
a careful analysis of work in a fully quantized setup, which should be free of spurious 
violations of the second law. 

A proper definition is based on the concept of passivity ( enard, 1978; Pusz and 
Woronowicz, 1978) explained below. Consider a quantum state pp. If pp undergoes an 
entropy-preserving (thermally adiabatic) process (e.g., a unitary transformation), the 
resulting energy change is purely work. In particular, it is possible to find the appropriate 
unitary transformation 

Pp i->- U pp =: pp (69) 

that maximizes the energy change while preserving the entropy, S(pp) = S{pp). thereby 
maximizing the extractable work, 

W£*(PP) = (^p)pp - (^p)pp ■ (70) 

This is the maximum work that can be extracted from the state pp (for a given Hp ), or 
its work capacity. Equation (70) requires pp to be passive: States are called passive, if 
they do not allow for work extraction, so that W^v (pp) = 0. 
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We may apply this concept to the analysis of a quantized heat machine (QHM). Let 
us assume that initially the piston is prepared in a state pp(0) with work capacity 
^max(/°p(0))- The QHM operation changes the state of the piston, so that at time t m it 
will be in the state pp(t m ) with work capacity Wffff x (pp(t m )). The work extracted by the 
piston is then the increase of the piston’s work capacity, 

Wext = W^ x (p P (t m )) - W^(pp(0)). (71) 


A heat engine is expected to deliver W ext > 0. Note that here we use a different sign 
convention than previously in order to be consistent with the work capacity definition. 

Since a Gibbs state has the minimal energy at a given entropy, Eq. (70) is maximized 
for 

<T2) 

Namely, we identify pp with an effective Gibbs state with a time-dependent (effective) 
temperature Ip(f) (Gelbwaser-Klimovsky et al., 2013b; Gelbwaser-Klimovsky and Kurizki, 
2014). Using this definition, one can calculate the maximum extractable power (Gelbwaser- 
Klimovsky et al., 2013b; Gelbwaser-Klimovsky and Kurizki, 2014) 


dVU\ d m d „ 

ir) =di Tp dt 5l> ' 


(73) 


where 5p is the piston’s entropy. 

Equation (73) clarifies the reason that not all of the energy interchanged by the piston 
is work—part of it involves an entropy change, heating up the piston. If the piston state 
is always a thermal (Gibbs) state, then 4j (ifp) = Tp4rSp and hence (dh-) = 0. 

This shows that a thermal state will not be able to extract work, thus resolving the 
apparent paradox proposed above. 

The complete QHM dynamics (including the piston) may be analyzed under the 
assumption that the system-piston coupling is weak, in addition to the assumption that 
the working fluid and the baths are weakly coupled as before (Gelbwaser-Klimovsky 
et al, 2013b). Under these assumptions, the working fluid will quickly reach its steady 
state, while the piston will slowly evolve. 

The Spohn inequality for fully quantized machines [cf. Eq. (31)] then reads 


_d 

dt 


Sp> — + — 
Th T c 


(74) 


and the efficiency, in the engine operation regime, is bounded by 


V — 



for Tp > T c 
for T c > Tp 


(75) 


Clearly, the second line exceeds the Carnot bound. This striking result shows that the 
quantum state of the piston is an hitherto unexplored thermodynamic resource—its 
negentropy may boost the QHM efficiency (see Fig. 10). This resource is outside the 
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Figure 10: A low-entropy piston is a thermodynamic resource that may temporarily boost 
the efficiency above the standard Carnot bound in the QHM of Fig. 9. 


standard assumptions that lead to the Carnot bound, therefore the extra efficiency is not 
forbidden by the second law. This resource may be thought of as an effective third bath, 
although the piston is not a real bath. A Carnot engine operating with three baths will 
bound the fully-quantum heat-engine efficiency (75), thus showing that this effect may 
be explained by classic thermodynamic arguments, if one considers the thermal resource 
provided by the piston state (Gclbwaser-Klimovsky and Kurizki, 2014). 

In the semiclassical regime we have studied in Secs. 2, 3, and 4, as in nearly all 
QHM models, the state of the external modulation field is ignored, i.e., it is assumed 
that its change is negligible, even if the QHM acts over infinite time. Clearly, this is a 
crude approximation if this field is appreciably amplified or depleted in the process. By 
contrast, in the present model that transgresses the semiclassical approximation, work 
extraction depends on the initial quantum state of the piston according to the following 
classification (Gelbwaser-Klimovsky et al., 2013b; Gelbwaser-Klimovsky and Kurizki, 
2014): 

• An initially thermal piston state remains thermal at all times and does not allow 
for work extraction. 

• An initial Fock state of the piston rapidly loses its non-passivity and thus its work 
capacity by thermalization (see Fig. 11). This “fragility” of Fock states does not 
allow them to increase their work capacity with time, so they do not extract any 
work at all. 

• The work capacity (non-passivity) of an initial coherent state of the piston increases 
exponentially with time, so that work extraction is possible at all times (see Fig. 11). 

• A quadrature-squeezed state remains non-passive at all times, but it produces 
higher entropy [cf. Eq. (73)] and therefore yields less work than a coherent state 
with the same mean energy. 

• If the piston is initially in a passive state, it will not extract work. Markovian 
evolution tends to preserve passivity. Nevertheless, it can be “ignited” by a small 
displacement in the phase plane away from zero energy. This displacement will 
render the state non-passive and will then allow for work extraction. 
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Figure 11: Comparison of work capacity in the QHM of Fig. 9 for two different initial 
quantum states of the piston (with the same initial energy): While a coherent 
state may increase its work capacity, a Fock state will inevitably lose it. 


We may conclude from Eq. (73) that the less entropy is produced by a state, the better 
this state is suited for work extraction. Resilience against thermalization is thus the 
relevant property for work extraction. The best state among the pure states for work 
extraction is the most “classical” one, the coherent state. However, it is remarkable that 
even if its phase is averaged out, it still retains a higher capacity for work extraction 
than other, non-classical, states (Gclbwaser-Klimovsky and Kurizki, 2014). 

5.3 Summary 

The definition of work and the concepts of work capacity and non-passivity of the piston 
state that we have invoked in a fully quantized heat machine revealed the conclusion that 
quantum states constitute thermodynamical resources that have been hitherto ignored. 
They can be used to boost the efficiency of quantum thermal engines without breaking 
the classical thermodynamic bounds. The key to work extraction is the resilience of the 
state to thermalization. Higher resilience ensures more non-passivity and therefore higher 
work extraction. 

For a large-amplitude coherent state of the piston, the results presented in Sec. 3 
are recovered ( Gelbwaser-Klimovsky and Kurizki, 2014). Hence, the periodically-driven 
model is a legitimate approximation in the case of semiclassical pistons (external fields). 
As in the continuous-cycle semiclassical heat engines of Sec. 3, the present fully quantum 
heat engines require spectral separation of the two baths. 

It is instructive to compare the present analysis to that of a maser, which can also 
be described as a heat machine (Scovil and Schulz-DuBois, 1959). Its thermodynamic 
efficiency is given by the ratio of the output (signal) to the pump frequencies, which is 
the same as the Carnot bound. In our scenario there is no population inversion in the 
system—the gain is provided by the hot bath, but the analogy is complete, as detailed 
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in (Gelbwaser-Klimovsky and Kurizki, 2014). Yet, the traditional maser analysis does 
not discern between coherent- and Fock-state gain underscored here. 


6 Self-contained quantum refrigerator with a quantum piston 

6.1 Motivation 

In this section we study—in analogy to the previous section—a fully quantum heat 
refrigerator with a quantized piston. The power source is thus also included in the 
model. Therefore, the QR is fully autonomous and may be miniaturized to the extreme. 
By contrast, most quantum refrigerator (QR) models (Brunner et a/., 2014; Chen and 
Li, 2012; Correa et al., 2013; Gemmer et al., 2010; Geusic et al., 1959; Gieseler et al., 
2012; Gordon and Ng, 2000; Guo et al . , 2012; Levy et al, 2012; Levy and Kosloff, 2012; 
Linden et al., 2010; Palao et al., 2001; Pekola and Hekking, 2007; Skrzypczyk et al., 2011; 
Velasco et al., 1997; Venturelli et al., 2013) are semiclassical, i.e., they require an external 
modulation (or an external heat bath) to power the refrigerator. 

In the preceding section we have found that work extraction by a fully quantized heat 
engine requires the quantum piston to be in a state with high resilience to thermalization, 
e.g., a coherent state. Here we show that efficient cooling (refrigeration) requires a different 
property of the piston quantum state. 


6.2 Refrigeration efficiency bound with a quantized piston 


From Spohn’s inequality for fully quantum heat machines [Eq. (74)], the coefficient of 
performance (COP) of the refrigerator is found to be (Gelbwaser-Klimovsky and Kurizki, 
2014) 
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(76) 


To calculate the COP, the refrigerator may be assumed to be powered by heat, (Hp) = 
TpSp, as in the case of an absorption refrigerator, or by work power, (Hp) = ^pf, as 
in a Carnot refrigerator, or by a combination of both. The balance between heat flow 
and work power that sets the maximum COP depends on the initial state of the piston. 

The first factor on the right-hand side of Eq. (76) is the standard Carnot bound (8) 
for a refrigerator. However, the extra factor may increase the COP above this standard 
bound provided that the sign of the extra factor is positive—this requires an increase of 
the piston entropy, i.e., ^5p > 0, while its energy is being reduced (thereby powering 
the refrigerator, i.e., ^ (Hp) pp < 0). Only non-passive states may achieve this boost, 
because a passive state is a minimal-energy state for a fixed entropy (see Sec. 5.2). Hence, 
any decrease in the energy of a passive state corresponds to its entropy reduction. 

Namely, only a quantum piston in a non-passive state may simultaneously power the 
QR and absorb heat from the cold bath by increasing its own entropy. The ability of 
the piston to absorb heat is not considered in the standard Carnot derivation, which 
therefore does not forbid the boost of the COP. 
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Amongst the non-passive states, the most suitable for cooling according to Eq. (76), 
namely those with the highest COP, are the most unstable states, i.e., the ones that 
maximize )^<Sp, as opposed to states that maximize work extraction by minimizing ^>Sp- 
We may classify the COP of non-passive states as follows (Gelbwaser-Ivlimovsky and 
Kurizki, 2014): 

• An initial coherent state, owing to its stability, i.e., the slow increase of its entropy, 
provides a COP just above the Carnot bound. Whilst their stability prevents 
coherent states from producing an excessive COP, it still allows them to surpass 
the Carnot bound at long times. 

• For an initial Fock state, the COP surpasses that of a coherent state with the same 
initial energy for a short time. The reason is that the Fock state is much more 
prone to thermalization, and its entropy initially increases very fast (see Fig. 12). 
At longer times its entropy saturates and starts decreasing, reducing the COP 
below the Carnot bound. Amongst all initially pure states with the same energy, 
the Fock state has the largest COP at short times. 

• For an initial thermal state of the piston at a high temperature (Tp > Th), the 
COP will be the same as for an absorption refrigerator (Palao et ai, 2001). The 
piston then plays the role of an “ultrahot” bath that powers the refrigerator. The 
piston will remain in a thermal state, but its temperature Tp will decrease until it 
reaches a critical temperature at which the cooling stops. 


6.3 Summary 

In Sec. 5 we showed how to maximize the work capacity of a quantum piston. This work 
can be used to power a QR, in the same way that a battery is used: The piston that 
was “charged” by the fully quantum heat engine may be subsequently used to power the 
fully quantum refrigerator. This “quantum battery”, once charged, does not require any 
external energy source to drive the QR. 

Non-passivity allows a state to power the QR while absorbing heat from the cold 
bath, thereby cooling it further. As opposed to work extraction, the more unstable 
a state becomes, the higher its COP at short times. Thus, we find again (cf. Sec. 5) 
that non-passive quantum states are thermodynamic resources that may improve the 
QR performance. As in the case of the engine, the extra efficiency originates from the 
properties of the state and not from the breakdown of any thermodynamic principle. 

7 Continuously-driven qubit as quantum cooler 

7.1 Motivation and model 

Up to now we have considered ovcoupling of the working-fluid TLS to the modulating 
held (piston), resulting in its energy modulation, as opposed to its <r x -coupling to the 
thermal baths. In this section we apply our general Floquet theory to a setup based on 
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Figure 12: (a) COP and (b) entropy of the piston in a QR (described by Fig. 9) for 
different initial states with the same initial mean energy as a function of time. 
A Fock state outperforms a coherent state at short times because its entropy 
change is larger than that of a coherent state. 


36 












a piston that drives the working-fluid TLS through o^-coupling, er,-coupling between 
the working fluid and a dephasing bath (I Uiaktavatsala Rao and Kurizki, 2011), and 
cr^-coupling of the TLS to another bath. This model allows us to explore the universality 
of the surveyed principles. In particular, we analyze the case of laser-induced cooling 
of a bath (buffer gas) at collisional equilibrium with the TLS (Szczygielski et al. , 2013; 
Vogl et al., 2011; Vogl and Weitz, 2009). This QHM allows cooling the bath down to an 
extremely low temperature (Gelbwaser-Ivlimovsky et al., 2015), without restricting the 
overlap between the bath spectra (unlike Secs. 3 and 4). 

The working-fluid TLS is driven by a laser (the piston), and is permanently coupled to 
two heat baths: By elastic (dephasing) collisions to the hot (h) bath, associated with the 
buffer gas (BG), and by spontaneous emission to the cold (c) bath, the electromagnetic 
(EM) vacuum. 

The laser-driven system Hamiltonian is assumed to be 

H s (t) = ^tuo 0 a z + hg{a + e~ lvt + cr_e 4I/t ), (77) 

where ujq is the (resonance) frequency of the TLS, v is the laser frequency and g is the 
coupling strength between the laser and the TLS. The laser detuning is A = ujq — v. 
The TLS coupling to the BG is via elastic collisions that do not change the TLS level 
populations (thus constituting a dephasing bath), described by 

#sb = <8> B h , (78) 

where B L is the dephasing (BG) bath operator. The coupling to the cold bath (EM 
vacuum) via spontaneous emission is given by 

H gB = cr x (g> B c , (79) 


where B c is the EM bath operator. 

Using the Floquet method developed in Sec. 2, a master equation is derived for the 
laser-dressed TLS coupled to the baths. The transitions induced by the EM (B c ) bath 
in the TLS are at frequencies v± = v ± Qq, where Qq = \/A 2 + 4 g' 2 and the BG (-Bh) 
bath induces transitions at Rabi frequency Hq- For typical realizations /?em hv± 3> 1, so 
that we may consider the EM bath to be effectively at zero temperature. For the BG, as 
shown below, cooling requires Pbg^g ~ U where /?bg is the BG inverse equilibrium 
temperature. This condition can be satisfied by appropriately adjusting the detuning A 
and the coupling g of the laser-field strengths. 

The evolution (master) equation yields for the TLS excited- and ground-state popula¬ 
tions p ee and p gg , respectively, 

Pee = -(ro + r+) Pee + {e~ h ^ G ^ G r 0 + r _) p gg , (80a) 

where the transition rates 

r »=(S) 2 °^ < 8ob > 
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Figure 13: Scheme of cooling a hot dephasing bath by a weak red-detuned laser acting 
on a TLS: Energy absorbed from the bath compensates the energy mismatch 
and yields spontaneous emission that cools the hot bath. 


are determined by G c and G^, the EM and buffer gas coupling spectra, respectively. 

The present cooling process can be understood as follows. The collisions with the BG 
broaden the TLS levels, allowing it to absorb a photon with less energy than its resonance 
frequency (cuo > v)- This process is accompanied by energy flow from the BG (hot bath) 
that compensates for the energy mismatch between absorption at v and spontaneous 
emission at ojq to the EM vacuum (cold bath). The BG temperature is thereby reduced 
(cf. Fig. 13). 

7.2 Cooling and heating as a function of laser parameters 

At long times the TLS, governed by Eqs. (80), reaches a steady state with an effective 
inverse temperature /3 tls> which is a measure of the TLS stationary level-population 
ratio and depends on the laser detuning. This inverse temperature, and therefore the 
laser detuning, allow us to determine the heat flow between the BG bath and the TLS. 

The heat current flowing from the BG (hot bath) to a single TLS is [see the derivation 
in (Szczygielski et al. , 2013)] 

J h = A (r + e" S/3BGnG - r) . (81) 

Here A is a positive process-dependent constant and the current is determined by the 
interplay of two different rates, cooling (r + e _ ^ BG ^ G ) and heating (r_). Their balance 
determines whether the BG bath is cooled down or heated up. 

In Sec. 3, highly efficient quantum heat machines required spectrally separated baths. 
Here, however, cooling depends on the coupling spectrum of the EM bath at two different 
frequencies, making the spectral separation irrelevant. Namely, we can ensure the cooling 
independently of the shape of the EM coupling spectrum. This advantageous property is 
clearly seen when the driving is weak (g <C |A|), since one of the rates r± is then zero: 
For A > 0, r-_/r + —>• 0, Jh > 0, thus cooling the BG, while for A < 0, r_/r + —)• oo, 
Jh < 0, heating the BG. 
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Figure 14: Theoretical (solid) vs. experimental (dashed) cooling power in the scheme 
of Fig. 13, realized by laser-driven TLS in contact with a hot buffer gas (at 
600 °C). 


It can be seen from Eq. (81) that cooling requires /?bg^G ~ 1, otherwise Jh may 
be negative. As the BG is cooled, /?bg increases, reducing the cooling power until it 
vanishes. By changing the detuning (and also the driving power), /3 bg^g may be kept 
constant, thereby maintaining the cooling power. This remarkable property of the present 
model allows changing controllable parameters (A and g ) to maintain the cooling down 
to ultralow temperatures. 

As a consequence of the second law of thermodynamics (through the KMS condition) 
there is a relation between the cooling and the heating power of the BG gas under weak 
driving, 

~ J T h [~ A) = e^ GhA . (82) 

dh(A) 

As shown in Fig. 14, this theoretical model accurately describes the cooling-power 
dependence on A, as experimentally measured in (Vogl et al., 2011; Vogl and Weitz, 
2009). 

7.3 Summary 

The present cooling machine was shown to represent a very versatile scheme for ma¬ 
nipulating the temperature of a bath such as a BG that causes pressure-broadening of 
laser-driven atoms, by simply changing the laser frequency. 

The only requirements for cooling in this scheme are a red-detuned laser frequency 
and weak driving, without restriction on the bath spectra. This stands in contrast to the 
cooling models in Sec. 3, where not only the modulation frequency had to be above a 
critical frequency, but also non-overlapping hot and cold bath spectra were required. The 
present scheme has distinct advantages (in terms of the minimum cooling temperature 
and cooling efficiency) compared to standard cooling techniques such as sideband cooling 
or Doppler cooling (Chu, 1998; Cohen-Tannoudji, 1998; Dehmelt, 1976; Epstein et al., 
1995; Hansch and Schawlow, 1975; Mungan et al., 1997; Phillips, 1998; Schliesser et al., 
2008; Wineland and Dehmelt, 1975; Wineland and Itano, 1979). 
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8 Cooling speed of quantum baths 

8.1 Motivation 

Here we are concerned with the third law of thermodynamics in its dynamical formulation, 
known as Nernst’s unattainability theorem, which forbids physical systems to cool down 
to absolute zero (T = 0) in finite time (Belgiorno, 2003; Landsberg, 1956; Nernst, 1906). 
In order to investigate this question (Kolar et al, 2012) we re-consider the quantum 
heat machine setup discussed in Sec. 3, consisting of a TLS whose transition frequency is 
periodically modulated by an external driving held, whilst being simultaneously coupled 
to cold and hot heat baths. The heat baths in Sec. 3 were assumed to have an infinite 
heat capacity, meaning that their temperatures are not modified in the course of cooling, 
regardless of the amount of heat exchanged between the working fluid and the baths. In 
this section, however, we assume the cold bath to possess a finite heat capacity , such that 
its temperature is progressively reduced as heat is extracted from it, i.e., when the heat 
machine is operated as a (quantum) refrigerator. 

8.2 Cooling-rate scaling with temperature 

Whilst the temperature of the hot bath remains constant throughout the time evolution, 
the temperature of the cold bath, whose heat capacity is finite, decreases due to heat 
being extracted to it via the work invested by the external (classical) driving field. From 
the definition of the heat capacity it follows that (Reid , 2009) 

CV^ = -Jo, (83) 

where a positive sign of J c corresponds to heat flowing from the cold bath to the working 
fluid. 

The heat capacity of the cold bath scales as (Kittel, 1987; Kolar et al., 2012; Reichl, 
2009) 

lirn Cy ~ T d (84) 

T c —>0 

at low temperatures, where d is the bath dimensionality. Under spectral separation of 
the two baths, the TLS is only coupled to the hot bath at u ~ cuo + f2, and at co — 
to both baths. The heat current J c is maximized if the modulation rate U satisfies the 
condition fojjQ — hU ~ /cbT c . This requires the modulation rate to be increased as the 
temperature decreases. The heat current (48) from the cold bath can then be shown to 
scale as (Kolar et al, 2012) 

J C (T C ) ex -Tfi+ d , (85) 

where 7 is a bath-dependent exponent determined by the spectral dependence (dispersion) 
of the system-bath coupling at low frequencies, 

lim \g(oj)\ 2 oc uj 1 . (86) 
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Figure 15: Cooling of a phonon bath (7 = 1 , solid line) and a magnon bath (7 = 0, dashed 
line) in the scheme of Fig. 4. The absolute zero is attained by a magnon bath 
at a finite time. 


Consequently, the time derivative of the temperature [Eq. (83)] scales as 


d % 
d t 


-Cl?, 


where the positive constant C is inversely proportional to the bath volume. 


(87) 


8.3 Cooling-rate dependence on bath dispersion 

Remarkably, the cooling speed (87) is determined by a single parameter 7 (Kolaf et al., 
2012; Levy et al., 201 ). For 7 = 1 the temperature T c decreases exponentially with time, 
in accordance with Nernst’s theorem (Belgiorno, 2003; Landsberg, 1956; Nernst, 1906). 
For smaller exponents 0 < 7 < 1, however, the temperature reaches absolute zero in 
finite time, in contradiction to Nernst’s theorem. 

As shown in (Kolaf et al., 2012 ), the value of 7 is related to the bath dispersion relation. 
Two typical cases can be discerned (see Fig. 15): 

• The dispersion relation of acoustic phonons reads w(k) ~ u|k|, v being the sound 
velocity. Their coupling to the system qubit scales linearly with the frequency, 
|< 7 (w )| 2 ~ |k| 2 /u;(k) ~ u>, resulting in 7 = 1 . Consequently, a bath of acoustical 
phonons approaches T = 0 exponentially slow [cf. Eq. (87)], in accordance with 
Nernst’s principle (Levy et al., 201l). 

• Spin-wave excitations (or magnons ) of a ferromagnetic spin lattice with nearest- 
neighbor interactions are bosons by virtue of the Holstein-Primakoff transforma¬ 
tion (Kittel, 1987). The dipolar coupling of these bosons to the system is independent 
of the frequency, i.e., 7 = 0 . Hence, the absolute zero is approached linearly in time 
[cf. Eq. (87)], thus violating Nernst’s unattainability principle (Kolaf ( t , 201 ). 
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8.4 Summary 

The validity of the third law is challenged within the quantum refrigerator model presented 
in Sec. 3, when the cold bath is described by a bosonic bath with finite heat capacity: 
Magnon baths may then be cooled down to absolute zero within a finite time. It is, 
however, important to bear in mind that the predicted violation of the third law has 
been derived within a simple model. It cannot be a-priori ruled out that in real systems 
modified interactions or couplings to additional baths arise at low temperatures, thereby 
effectively reducing the cooling rate. The fundamental nature of the third law and the 
possible implications of its invalidity calls for experimental verification of these predictions, 
preferably in “clean” (isolated) and controllable environments, e.g., within optical lattices 
that can emulate magnon baths (Diehl et, al. , 200' ) in order to clarify these results. 

9 Control of non-Markovian thermodynamic processes 

Having analyzed various models of thermal machines based on Markovian dynamics, we 
present in the last parts of this review (Secs. 9 and 10) the results of a non-Markovian 
model. To this end we consider a qubit (TLS) subject to frequent measurements or phase 
shifts on time scales shorter than the memory time of the bath to which it couples. This 
dynamical control affects the system-bath correlations and allows for work extraction. 

Quantum thermodynamics is usually based on long-time Markovian (Lindblad) master 
equations, which describe convergence to equilibrium at a constant rate. By contrast, the 
understanding of non-Markovian short-time effects in quantum thermodynamics is scanty 
at best. Here we explore one such non-Markovian process: An impulsive (brief) quantum 
non-demolition (QND) measurement of the qubit energy or its phase shift disturbs its 
equilibrium with the bath, thereby abruptly changing its temperature. The subsequent 
evolution of the qubit in the presence of the bath alternates between heating and cooling 
at times comparable to the qubit oscillation period (Erez et al., 2008; Gordon et al, 2009). 
Such effects are at odds with the standard Markovian notions of thermodynamics (Alicki, 
1979; Kosloff, 2013; Spohn, 1978), whereby temperature and entropy must monotonically 
converge to their equilibrium values. 

9.1 Model 

The basic model is the one already encountered within the present review, namely a 
qubit (TLS) with modulated transition frequency as in Eq. (44). However, it is here 
permanently coupled to a single heat bath B via the spin-boson Hamiltonian and is 
subject to ov-control (Kofrnan and Kurizki, 200' ) 

Htot = H s (t) + H B + H SB , (88a) 
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with the constituents 



(88b) 


Hb = h^u k a\a k 


(88c) 


k 



(88d) 


k 


Here uj(t) is the modulated (via phase shifts) or randomized (via impulsive measurements) 
qubit resonance frequency, a x is the x-Pauli operator, and a k (a\.) are the annihilation 
(creation) operators of the bath. Finally, p k denotes the matrix element of the o^-coupling 


of the system to the bath mode k. We stress that we do not invoke the rotating-wave 
approximation (RWA) ( Cohen-Tannoudji et al. , 1989) in the interaction Hamiltonian 
Hsb- Namely, we do not impose energy conservation on the excitation exchange between 
the system and the bath, on the time scales considered (Kofman and Kurizki, 200 ). 
Nevertheless, the total energy is conserved by H tot when H$ is time-constant. 

9.2 System-bath correlations at equilibrium 

At equilibrium, the qubit and the bath are inevitably in an entangled (correlated) state 
given by the density matrix for the total system and the bath, p eq = exp(— (5H to t)/Z, 
where Z is the partition function and 1/(5 = UbT. Its off-diagonal elements express 
quantum correlations between the qubit and the bath. These correlations are concealed 
when observing only the qubit state, p = Ttb p e q- Yet these correlations increase the 
temperature (mixedness) of p as the system-bath coupling grows (Gordon et al., 2009). 
Even at zero temperature, the state-purity of a qubit is never complete, due to system- 
bath entanglement. As the bath temperature rises, this purity exhibits a non-monotonic 
dependence on (5. 

For a Lorentzian coupling spectrum of the bath of width T (centered around vq) 



(89) 


the mean interaction energy at T = 0 is given by the bath-induced Lamb shift (( 'ohen- 
Tannoudji et al., 1989) in the form 



(90) 


where coq denotes the unperturbed qubit resonance frequency. The negativity of the 


mean system-bath interaction energy in equilibrium will play a crucial role in subsequent 
calculations. 
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9.3 Impulsive perturbations of a qubit at equilibrium 

We consider the effect of quantum non-demolition (QND) operations performed on the 
qubit by a device through the Hamiltonian ffgD, he., operations that commute with the 
operator a z (Erez et ai, 2008). If performed at the right rate, these QND operations 
enable the gradual purification (cooling) of qubits coupled to a non-Markovian bath, 
although they are non-selective, i.e., their results are neither read out nor acted upon. It 
is necessary that ihsD oc a z , i.e., that it does not commute with H^b oc a x , otherwise a 
classical-like force acts on p, changing it in a non-QND fashion. Examples of such QND 
operations are projective measurements of the qubit energy or its phase flips. 

In a projective measurement of a z , the state is projected onto the energy eigenstates 
|e) and | g), such that the joint system-bath (SB) state after the measurement (M) is 
changed from p eq to (Gordon et ai, 2009) 

PSB = Peq'-tPSB = ^(Peq + ^Peq^)- (91) 

By contrast, a phase shift results in a rotation of the state about the z axis by a phase <f>, 

Peq ^ Psb = exp(-i(j)a z /2)p eq exp(i(j)a z /2). (92) 

Such a rotation may be realized by an ac Stark shift of the qubit’s resonance frequency 
by an external field. 

By the definition of a QND operation, the qubit excitation would not be altered—if 
the qubit where isolated. However, due to its interaction with the bath (which does not 
commute with -Hsd), <Jz operations result in alternate heating and cooling of the qubit, 
depending on the time interval between consecutive QND operations. As shown in (Gordon 
et al. , 2009), the system-bath correlation energy (Hsb) is increased by an impulsive 
QND projective measurement by |(-ffsB) eq l> where the latter quantity [cf. Eq. (90)] 
corresponds to the energy cost of erasing the system-bath correlations (entanglement). 
The joint system-bath density matrix is thus transformed into an approximately factorized 
form (Erez et ai, 2008). By contrast, phase shifts retain the system-bath correlations but 
modify the off-diagonal elements of the density matrix (Gordon et ai, 2009). However, 
as a result of either projective measurements or phase flips, the joint system-bath state is 
transformed into a non-equilibrium state that starts evolving. 

9.4 Post-measurement state and its free evolution: Alternating heating and 
cooling 

The joint system-bath post-measurement state satisfies (Erez et al., 2008) 

pf B « Z~i e -P( H s+ H B+Oi H h)) 5 (93 ) 

which for sufficiently weak coupling (small ?? max ) can be approximated by the product 
state 

Psb«P®Pb- (94) 
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The evolution of p at longer times can be approximately described by a non-Markovian 
master equation (Alvarez et ai, 2010; Gordon et al., 2009, 2010). The latter equation is 
equivalent to the rate equations (Gordon et ai, 2007; Kofrnan and Kurizki, 2004) 


Peeif) — Pggft) — Rg(t)Pgg Reif)Pee (95a) 

/ oc 

do;Gr(w) sine [(a; ^ wo)t] (95b) 

-OO 

for the qubit populations. Here sinc(x) := sm ( x ) , and Gt{oj) is the temperature-dependent 
bath response. We shall assume that Go(co), the zero-temperature coupling spectrum, 
is peaked at ujq and has spectral width ~ 1 /t c , the inverse memory time. The qubit 
dynamics is thus given by the time-dependent absorption (relaxation) rates R e ^(t). We 
can identify three distinct regimes according to their typical time scales: 

• At short times t <C l/a>o <S t c the sine function is much broader than Gt(oj), 
resulting in equal rates R e ( g ) at any temperature. In this regime the RWA [See 
Eq. (88d)] breaks down, as both excitation and de-excitation of the qubit do 
not require absorption or emission from/to the bath, but rather a change in the 
system-bath interaction energy. The transition rates are then linear in time, 


R e { g )(t <C t c ) ~ 2 R 0 t 

roo 

Ro= (1 ujGt{u), 


(96a) 

(96b) 


consistently with the quantum Zeno effect (QZE) of relaxation slowdown (Ivofman 
and Kurizki, 2000, 2004). The heating rate in this QZE regime is (Erez et al, 2008; 
Gordon et al, 2009, 2010) 

^ (Pee ~ Pgg) ~ 4 Rot(pgg — p ee ). (97) 


• At intermediate (but still non-Markovian) times, t ~ l/wo, the width of the sine 
function and the coupling spectrum become comparable, causing damped oscillations 
of the transition rates near the frequencies wo ± z'tn respectively. This oscillatory 
behavior neither conforms to the QZE nor to the anti-Zeno effect (AZE) that 
signifies relaxation speedup. It may be dubbed the oscillatory Zeno effect (OZE). In 
this non-RWA regime the transition rates can adopt negative values (since the sine 
function can become negative). Since R g (t ) is more likely to become negative than 
its counterpart R e {t), there can be a larger growth of the ground-state population 
than allowed by detailed balance, i.e., transient cooling can be observed at these 
intermediate times (Gelbwaser-Klimovsky et al , 2013c). 

• At long times t f c , the relaxation rates attain their Golden-Rule (Markovian) 

values (Kofrnan and Kurizki, 2004) R e ^(t t c ) ~ 27rG'r(±wo)- The populations 

then approach those of an equilibrium Gibbs state whose temperature is equal to 
that of the thermal bath (see also Sec. 2). 
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Figure 16: Demonstration of Zeno heating at short measurement intervals [due to counter¬ 
rotating terms in the Hamiltonian (88d)] and anti-Zeno cooling at longer 
measurement times (due to rotating-wave terms therein) in an NMR experi¬ 
ment (Alvarez et al., 2010). The normalized population difference is . 

How can one interpret the non-Markovian transient cooling due to the impulsive 
disturbance? As shown in (Gordon et al., 2009), the energy change of the system can be 
related to the respective changes of the bath’s internal energy and of the system-bath 
correlation energy according to 

5 (H s (t)) = -[S (H B (t )) + S (H SB (t))}. (98) 

Oscillations induced by co-rotating terms (confirming to the RWA) result in energy 
exchange between the system and the bath, 6 (i?s) = — 5 (H B ), whilst counter-rotating 
terms cause a rapid variation of —[SH B (t) + 5 (i?sB (£))]> resulting in the qubit heating, 

S(H s ) > 0 . 

Upon repetition of this QND measurement procedure, the qubit is heated up or 
cooled down, depending on the time intervals between the measurements as verified 
experimentally (see Fig. 16). The bath and the system are affected differently and may 
thus acquire different temperatures. Remarkably, the system may heat up solely due 
to the QZE, although the bath is colder, or cool down solely due to the OZE or AZE, 
although the bath is hotter (Gordon et al., 2009, 2008, 2010). The bath, by contrast, may 
undergo changes in temperature and entropy only if its heat capacity is finite. 

9.5 Non-monotonic entropy evolution: Spohn’s theorem violation 

One may introduce the “entropy distance”, i.e., the entropy of a system-state p relative 
to its equilibrium state po according to (Alicki, 1979; Lindblad, 19 ) 

«5(p(*)||po) := Tr[p(t)lnp(f)] - Tr [p(t) Inp 0 ] . (99) 
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The entropy-production rate then reads aft) = —4^S(p(t)\\po). In the Markovian regime, 
it follows from the second law that aft) > 0 ( Ticki, 1979; Lindblad, 1974; Spohn, 197 ). 
For diagonal p, aft) is positive iff ^ | p ee ft) — (po)eel < 0- Yet, in the non-Markovian 
domain, p ee {t) may drift away from its equilibrium value, so that aft) becomes negative, 
thus violating Spohn’s theorem [cf. Eq. (6)] (Erez et al, 2008; Gordon et at., 2009): 
Equilibration need not be nronotonic at non-Markovian times. 

9.6 Summary 

Periodic perturbations of a system that is initially at equilibrium with a thermal bath dis¬ 
rupt the equilibrium conditions, driving the system away from its original state, although 
these perturbations are quantum non-demolition (QND) operations (measurements or 
phase shifts) that would not change the system energy, if the system were isolated from 
the bath. The perturbed evolution strongly depends on the perturbation rate: Heating is 
obtained under extremely frequent perturbations that correspond to the quantum-Zeno 
domain, and cooling under less frequent ones associated with the anti-Zeno effect. These 
predictions were experimentally confirmed by an NMR experiment ( dvarez et al., 2010) 
in which a carbon nuclear spin coupled to a bath of three protons was either heated up 
or cooled down by noise pulses (that mimicked QND measurements), depending on their 
rate (see Fig. 16). 


10 Work-information relation under non-Markovian evolution: 
Violation of the Szilard-Landauer bound 

10.1 The Szilard-Landauer principle revisited 

The Szilard-Landauer (SL) principle states that work obtainable from a measurement of 
a quantum system cannot exceed the energy cost of erasing its record from the observer’s 
memory (cf. Sec. 1) (Bennett, 1973; Landauer, 1961; Szilard, 1929). This means that an 
observer can extract work from a system upon modifying it according to the results of 
its measurement. Such an omniscient observer is commonly referred to as “Maxwell’s 
demon”. But what happens if the information obtained from a measurement is not read 
out, i.e., for non-selective measurements (NSM)? Is it still possible to extract work in 
such a scenario? 

Here we present a possibility to extract work from NSM and obtain a larger amount of 
work than that predicted by the SL principle, by exploiting the energy obtained from 
the change of the system-bath correlation energy through an impulsive measurement (cf. 
Eq. (90) and Sec. 9.3). 

The protocol is as follows (see Fig. 17) (Gelbwaser-Klimovsky et al., 2013d): A brief 
QND measurement decorrelates the system from the bath, thus altering their correlation 
energy (Hsb)- Subsequently, a periodic modulation of the qubit’s transition frequency 
allows for work extraction even if the measurement result remains unread, i.e., for a NSM, 
provided that the cycle is completed within the bath memory time, so as to allow for 
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Figure 17: Sketch of a work-extraction cycle induced by a QND non-selective measurement 
(NSM) of the qubit energy, followed by its cyclic energy modulation effected 
by a classical piston. Throughout the cycle, the qubit is in contact with a 
bath at temperature T. 


temporal changes in the correlation energy that only take place on non-Markovian time 
scales. 

10.2 No work can be extracted from a single Markovian-bath in a closed 
cycle 

Let us revisit the rate equations (95a) under Markovian conditions, i.e., positive transition 
rates, for a thermal (Gibbs) state pjj(t) = Z~ 1 {t)e~P E M t \ 

Re(t)pt q e (t) = Rg(t)p%(t). ( 100 ) 

One can then prove (Gelbwaser-Klimovsky et al, 2013d) the following inequality for the 
von Neumann entropy (4), 

5 = -k B J2 hi ln Pjj > ~ k B J2 hi ln pTj = t®' ( 101 ) 

3 3 

with Q = Ydj Pjj E i- F° r a dosed cycle the initial and final state’s entropy and energy are 
the same, and hence 

W-cyde = Q< 0, (102) 

which corresponds to supplying work to the system. Here the work extracted in a cycle is 
negative, i.e., it must be invested from the outside. 
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10.3 Work extraction in a non-Markovian cycle 

The extractable work in the cycle described above (Fig. 17), which is the negative of the 
work defined in Eq. (3b), satisfies, on general grounds (Alicki, 1979), 


ie = -j> Tv{pH s }dt = -j> s(t)u(t)dt. (103) 

Here, as in Eq. (88b), ui(t) is the time-dependent qubit transition frequency and s(t) is 
the qubit’s level population difference. As shown by Eq. (102), no work can be extracted 
in the Markovian regime. However, work can be extracted within such a cycle (lk^ le > 0) 
if the modulation happens on a non-Markovian time scale, i.e., for a modulation rate 
Q that satisfies H l/t c (Gelbwaser-Klimovsky et al., 2013d). For this to happen, u(t) 
has to oscillate out of phase with s(t). 

As discussed above in Sec. 9.3, an impulsive projective measurement decorrelates the 
system and the bath, thereby increasing their correlation energy by [cf. Eqs. (90) and (98)] 


AE meaa — (-HsB)eq > 0. 


(104) 


Here we encounter an important difference to the Szilard-Landauer (SL) scenario, where 
system-bath correlations are not accounted for. Assuming a cycle duration well below 
the bath memory time, t cyc \ e <C t c , but longer than the time needed to perform the 
measurement that triggers the cycle, the maximal amount of extractable work is (Erez, 
2012 ) 


(^nsm) 


max 


A-EAeas — TASrr 


(105) 


where A5 meas is the entropy increase due to the measurement. 

A post-measurement cycle allowing to extract work (W^ le > 0) can be designed. As 
in Secs. 2, 3, and 4, the “piston” is realized by a periodic modulation of the qubit’s 
transition frequency of the form u(t) = ujq + k sin fit. In the weak-modulation regime 
k <C 12, the work extracted within a cycle evaluates to (Gelbwaser-Klimovsky et al., 
2013d) 

2t r 

W®ypie ~ — At f J s (i)flcos(fli)df, (106) 

with J g {t) = fg Rg(t')dt'. Upon modulating the system on non-Markovian time scales 
(typically for H At ~ wo), Eq. (106) allows for either positive or negative work extraction, 
owing to its sign oscillation with H. This means that the energy invested by performing 
the NSM [Eq. (104)] can be partly extracted as work, but only in such a non-Markovian 
cycle for an appropriate choice of H and k (Fig. 18). This invested energy can be in the 
form of noisy pulses (Alvarez et al., 2010). 


10.4 Work-information relation for a non-Markovian cycle 

Having shown that work extraction through a non-Markovian cycle following a NSM is 
possible, we now compare this result to the SL result. The relation between (kF s e e 3 i t )max 
(for a selective measurement) and (W§g t M ) max (for a non-selective measurement) shows 
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Figure 18: Simulation of the extractable work per cycle of the NSM-based scheme in 
Fig. 17 as a function of the cycle duration (in units of the bath correla¬ 
tion/memory time t c ). It is seen that for cycles longer than t c positive work 
may not be extracted. 

that the maximum work extractable from a selective measurement is higher than the 
Szilard-Landauer (SL) bound Wsl (Gclbwaser-Klimovsky et ai, 2013d), 

(Wsef ) m ax = WsM)max + W Sh . (107) 

As detailed above, the extra work (W r ^-g t M ) max stems from system-bath correlations, which 
are not accounted for in the SL treatment. Equation (107) demonstrates the difference 
between the Markovian and the non-Markovian case: System-bath entanglement is not 
included in the Markovian treatment and consequently (H / Ng t M ) max = 0 there. Hence, in 
the Markovian limit the maximum extractable work by a selective measurement adheres 
to the SL result. 

Remarkably, the NSM allows for extracting work from a reservoir at T = 0 with¬ 
out information gain (Gelbwaser-Klimovsky et ai, 2013d): The system-bath correla¬ 
tions (90) are always negative, even for T = 0. Decorrelation of the system and the 
bath through a measurement will increase this energy, such that the cycle is triggered, 
yielding (W^f^max = (H / Ng t M ) max > 0. In this scenario all extractable work stems from 
this correlation energy change (see Fig. 19). 

10.5 Consistency with the second law 

The joint system-bath state at equilibrium p eq , which is entangled, is changed to a product 
state p® pb by the measurement (performed by a detector D ). The total Hamiltonian 
describing this setup is 

Htot = #s+B + #bd + -Hsd, (108) 

with the system-detector interaction Hsn and the bath-detector interaction, 77 bd, re¬ 
spectively. This total Hamiltonian is r-periodic [Htot( T ) = Lftot(0)], such that the work 
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Figure 19: Comparison of the Szilard-Landauer (SL) bound on extractable work with 
that extractable in the NSM-based scheme of Fig. 17, as a function of the 
bath temperature k^T. It is seen that at low temperatures the NSM-based 
work can greatly surpass the SL bound. 


extracted within a cycle amounts to (Gelbwaser-Klimovsky et al., 2013d) 
W£?(r) = - TV \u(r)p tot (0)U\r)H tot (0) - p tot (0) H tot (0) 


(109) 


which is the difference between the final and the initial mean energy. Owing to the unitary 
nature of the total time evolution, the entropy of the joint (system-bath-detector) density 
operator p tot is fixed. Equation (109) then yields 

= - j> Tr ( Ptot H tot ) dt = —A £ meas + W^ le < 0. (110) 

Here AE meas is as in Eq. (104) and W^ycie i s as i n Eq. (106) and we have used the fact 
that the mean energy at fixed entropy is minimized for a thermal equilibrium state. 
Hence, no work can be extracted from a single bath by the entangled evolution of the 
joint (system-bath-detector) “supersystem”, consistently with the second law. 


10.6 Realizations and practical consequences 

Consider TLS (atoms or molecules) with resonance frequency ojq in the microwave domain 
in a high-Q cavity with controllable finite-temperature. QND measurements of the atomic- 
level population can be performed by injected optical probe pulses. Such QND probing 
may be performed at time intervals shorter than (Gordon et al., 2009). 

The cavity modes constitute a bath with memory (correlation) times t c ~ 10~ 4 s ( 
rosyan et al, 2009; Verdu et al., 2009). The systenr-bath correlation energy (Hsb) (and 
thus the measurement-induced work) may then attain the GHz range. In this setup the 
piston is realized by an off-resonant coherent signal that modulates the atomic transition 
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Figure 20: Schematic view of a possible setup for the realization of the NSM-based scheme 
in Fig. 17, using two-level atoms in a cavity (that serves as a bath) subject to 
periodic QND measurements and off-resonant energy modulation by optical 
(laser) probes. 

frequency at a rate D l/t c - The QND measurement of the atomic population is per¬ 
formed by injected pulses (much shorter than the bath memory time). An amplification 
(lasing) of the off-resonant coherent piston mode will then signify work extraction (see 
Fig. 20). 

10.7 Summary 

The predicted work extraction above the Szilard-Landauer bound is at the expense of 
the change in the system-bath correlation energy (consistently with the first law). The 
second law is also adhered to when including the measuring device in the calculation of 
the energy and entropy changes. 

An application of this scenario might be the transformation of (possibly very noisy) 
energy input into work, which is manifest by a coherent amplification of the piston field. 
It might also be useful in situations where the coupling of the system to two different 
baths (as required by standard heat machines) is very hard to implement experimentally. 

11 Discussion and outlook 

11.1 Motivation and main issues 

The study of models of thermal quantum machines is a necessary step in the strive to 
clarify the interplay between quantum mechanics and thermodynamics, and the limits 
set by thermodynamics to the performance of quantum devices. As discussed in this 
review, thermodynamics does impose limits on quantum processes and these limits are in 
general similar to the classical ones. Yet, extra resources associated with “quantumness” 
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may cause quantum machines to outperform their classical counterparts, while adhering 
to the second law: Multilevel degeneracy (quantum-correlated multiple thermalization 
pathways) can cause a power boost compared to a two-level machine (Sec. 4); quantum- 
state preparation of the “piston” may endow a quantum heat machine with efficiency 
higher than the standard Carnot bound, in contrast to its semiclassical limit that conforms 
to the Carnot bound (Secs. 5 and 6); system-bath entanglement allows an engine to 
transgress the Szilard-Landauer bound (Sec. 10); Nernst’s unattainability principle is 
challenged by the finite cooling speed of a quantum (magnon) bath as the absolute zero is 
approached (Sec. 8). In what follows we shall dwell on the key aspects of these quantum 
resources and their potential applications. 

11.2 Continuous-cycle modulation-driven heat machines 

The Floquet analysis of periodically-driven open quantum systems presented here 
(Secs. 2, 3, and 4) shows that continuous-cycle quantum thermal machines may have 
an important edge over reciprocating (strokes-cycle) machines, of which the Carnot or 
the Otto cycles are known examples (Sec. 1.3). Reciprocating-cycle operation incurs the 
entropic and energetic costs of abrupt consecutive strokes, especially when these strokes 
become rapid and non-adiabatic. This non-adiabaticity is not only difficult to keep track 
of, it also causes a decrease in the reciprocating-cycle efficiency as their non-adiabaticity 
increases (Curzon and Ahlborn, 1975; Geva and Kosloff, 1992a, b; Kosloff, 2013). By 
contrast, the continuous-cycle o^-driven quantum heat machines (QHM) may attain the 
Carnot efficiency limit precisely because of its cycle non-adiabaticity (high modulation 
rate). Namely, it can be as efficient as the ideal, infinitely-slow, reciprocating heat engines. 

Yet, the periodically-driven continuous QHM, while being conceptually simple and 
performing efficiently under extreme non-adiabaticity, has a basic limitation: It reaches 
the Carnot efficiency bound provided that the hot and cold baths are spectrally separated. 
This “price” to be paid for having both baths permanently coupled to the system (working 
fluid) can be understood as follows. The “natural” energy-flow direction is from the hot 
bath to the cold one, without producing any work. In quantum oscillator baths, however, 
the heat will flow from the mode with a larger thermal occupancy to the one with a lower 
occupancy. Then, heat will flow from bath 1 to bath 2 if their respective products of 
inverse temperature and frequency satisfy /3ihio\ < Thus, spectral separation of 

the baths is required to select the modes and temperatures that produce work or cooling. 
Without modulation, the heat flows (currents) from the hot (h) and the cold (c) baths 
have the same absolute value with opposite signs, Jh = — J c > 0. As the modulation 
frequency increases, Jh decreases while J c increases and may allow for work extraction, 
until they switch signs, thereby triggering refrigeration (cf. Fig. 4 in Sec. 3). These two 
operation regimes are separated by a critical modulation frequency, at which the machine 
reaches the maximum allowed efficiency, the Carnot bound, corresponding to zero power 
or cooling power (Sec. 3). 

On the practical side, these continuous-cycle models may be useful for understanding 
and optimizing future nanomachines. At nanoscales, systems are completely embedded by 
their surrounding, making on-off switching of the coupling to thermal baths impossible. 
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Hence, “strokes” cycle models may not be useful and systems permanently coupled to 
the thermal baths may become indispensable. 

Are there alternative continuous-cycle models? In Sec. 7 a scheme that does not require 
spectrally separated baths for cooling was presented. It aims at cooling a bath that 
dephases two-level systems continuously driven by a field, e.g., it achieves buffer-gas (BG) 
cooling via its collisions with laser-driven two-level atoms (Vogl et al. , 2011; Vogl and 
Weitz, 2009). The thermodynamic analysis of this process (Sec. 7) reveals that it may 
be viewed as a laser-driven heat distributor rather than a refrigerator—it uses the laser 
power to cool down the BG without any restriction on the bath spectra, as long as the 
laser is red-detuned from the atomic resonance. This cooling may attain high efficiency 
at ultralow temperatures. 

11.3 Multilevel degeneracy as a resource in heat machines 

The generalization of the minimal universal QHM based on a two-level system (Sec. 3) to 
the degenerate multilevel case reveals the possibility of a significant enhancement of the 
engine’s output power (Sec. 4). An enhancement (boost) is achievable for any transition- 
dipole orientation, but its temperature dependence is determined by the dipole alignment. 
The maximally possible enhancement over the entire temperature range is achieved if all 
dipole transition vectors are aligned, provided that coherently-superposed multilevel dark 
states are initially unpopulated. The initial population that yields maximal enhancement 
can then be an arbitrary mixture of the ground and the bright (coherently-superposed) 
state populations. In particular, an initial full population of the ground state ensures 
maximal enhancement. Hence, initial (or steady-state) coherence is neither required nor 
is it always beneficial for the performance boost. In fact, the power boost depends on 
the ground-state population of the working fluid in steady state. Notwithstanding this 
boost, the efficiency or COP of the heat machine is not altered compared to its TLS 
counterpart. 

11.4 Fully quantized versus semiclassical heat machines 

In analogy to atom-light interaction theory, the machines surveyed above are termed 
semiclassical, because they are driven by an external classical field. A step towards the 
complete quantization of heat engines was taken here: A “quantum piston” was used 
as the drive instead of a classical external field (Secs. 5 and 6). Yet, fully-quantized 
heat machines pose conceptual challenges. Whilst it is clear how to calculate the energy 
exchange between interacting quantum systems, it is unclear how to divide it into work 
and heat (Sec. 1.4). Some of the different proposals for defining the work exchange at the 
quantum level claim an efficiency higher than the standard Carnot bound ( Vllahverdyan 
and Nieuwenhuizen, 2005; Boukobza and Tannor, 2006; Goswami and Harbola, 2013; 
Horodecki and Oppenheim, 2013; Schroder and Mahler, 2010). Yet, the origin of the 
extra efficiency in these proposals is not clear, casting doubts on the definitions they use. 

The definition of work based on passivity (Lenard, 1978; Pusz and Woronowicz, 1978) 
was shown here to comply with thermodynamics and retrieve in the semiclassical limit 
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all the results of classical external driving (by a semiclassical piston). By contrast, work 
extraction by a quantum piston was shown not only to depend on the heat currents 
and the spectral separation of the baths, but also on the piston state’s non-passivity: 
High work efficiency requires sustainable non-passive, stable piston states (resilient to 
thermalization) that yield a low entropy production, for example an initial coherent state. 
Conversely, no work is extracted for a state that rapidly loses its non-passivity, e.g., an 
initial Fock state (Sec. 5). By contrast, in the refrigeration regime, the cooling COP is 
increased when the piston is initially in a Fock state (that evolves with a high entropy 
production) (Sec. 6). Remarkably, the work or the cooling efficiency in a fully quantized 
heat machine may surpass the standard Carnot limit. The origin of this extra efficiency 
is the possibility of the piston to absorb heat, adding an extra thermodynamic resource 
to the heat machine (Gelbwaser-Klimovsky and Kurizki, 2014). A new classification of 
quantum states based on their work extraction and cooling capacities need be pursued. 
In the case of work extraction, there are indications that pointer states (Zurek, 1981) are 
the best candidates in terms of their sustainable non-passivity. 

Fully quantum heat machines may play a special role in nanotechnological applications. 
Their quantized piston can allow maximal compactness (miniaturization) and completely 
autonomous (self-contained) operation. 

11.5 Applications to quantum refrigeration and work extraction 

An important potential application of the present results is towards overcoming the main 
bottleneck of electronics miniaturization, which is the heat produced in the microprocessor. 
As microprocessors become smaller and denser, heat generation may render them unusable. 
Hence, to continue the miniaturization trends, new and more advanced cooling methods 
are required (Gordon et al., 2009; O’Connell et al., 2010; Petrosyan et al., 2009; Pop 
et al., 2006; Taylor et al., 2011; Zhao et al., 2012) than standard cooling of gases and 
solids (Chu, 1998; Cohen-Tannoudji, 1998; Djeu and Whitney, 1981; Epstein et al., 1995; 
Hansch and Schawlow, 1975; Hoyt et ai, 2003; Phillips, 1998; Sheik-Bahae and Epstein, 
2007; Thiede et al, 2005; Zander and Drexhage, 1995). The sought methods must be 
thermodynamically efficient at quantum scales. 

This question has largely motivated the recent interest in models of quantum refrigera¬ 
tors (QR) ( losloff, 2013). Yet, most of these models have been inspired by the Carnot or 
Otto cycle (Allahverdyan et ai, 2010; Brunner et al., 2014; Correa et al., 2013; Geusic 
et al., 1967; Geva and Kosloff, 1996; Gordon and Ng, 2000; Levy and Kosloff, 2012; 
Linden et al., 2010; Palao et al., 2001; Velasco et ai, 1997; Venturelli et ai, 2013). 

By contrast, impurities and double-well qubits embedded in appropriate environments 
may act, depending on their energy modulation, in either the engine (QHE) or the 
refrigerator (QR) mode of the proposed continuous cycle QHM (Gelbwaser-Klimovsky 
et ai, 2013a), with potentially significant technological advantages. In particular, an 
impurity or quantum-dot fast-modulated qubit “sandwiched” between two nanosize 
solid layers (Fig. 6) may act as a nanoscopic refrigerator (heat-pump) of a transistor 
(chip), that is much more miniaturized and less power-consuming than currently available 
microelectronic refrigerators (Pop et ai, 2001 i). 
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Under slower modulation rate, the same setup may act as electron-current generator 
without external voltage bias, and as a substitute for phase-coherent electron-current 
control (Kurizki et ai, 1989). The realization of these novel machines in NV-center spin 
ensembles or nano mechanical platforms will constitute a major technological leap, as 
their present counterparts are based on traditional thermodynamical principles. 

Fully-quantized system-piston couplings analyzed in Secs. 5 and 6 are realizable in 
well-investigated experimental setups: 

• A superconducting flux qubit S dispersively coupled to the piston P may be realized 
by a high-Q (phonon) mode of a nanomechanical cavity (or cantilever), as shown 
in Fig. 21. The quantized position of P (cavity-mirror strain) affects the magnetic 
flux through the qubit and thereby modulates its frequency u>o- 

• Alternatively, P can be a held mode of a coplanar resonator (Blais et al. , 2004) 
whose quantized electromagnetic held amplitude affects the magnetic flux through 
a superconducting qubit (see Fig. 21). In such scenarios, it should be possible to 
amplify the output signal within the P-mode coherence time. Similar considerations 
may apply to cold atoms (Petrosyan et al. , 2009) or spin ensembles (Ivubo et al . , 
20b ) in high-Q cavities. 

• In an optomechanical cavity-setup the mechanical degree of freedom may play the 
role of the piston, the optical held mode be the working fluid, and the electromagnetic 
vacuum may act as the cold bath. Optical couplers may be used to inject radiation 
into the cavity from a hot bath, e.g., solar radiation (see Fig. 22). The ability 
to prepare the quantum state of the mechanical piston (Aspelmeyer et al. , 2014; 
Rimberg et al. , 2014; Vanner et ai, 2011) identify optomechanical setups as a 
leading platform for exploiting the thermodynamic properties of quantum states 
surveyed here (Gelbwaser-Klimovsky and Kurizki, 2015). 

11.6 Third law and unattainability challenged 

Quantum machines must comply with the second law of thermodynamics, but may differ 
from their classical counterparts concerning compliance with the third law formulated as 
Nernst’s unattainability principle (Sec. 8). A quantum refrigerator with the appropriate 
coupling may approach the absolute zero at finite time, as predicted for certain realistic 
quantized baths, e.g., quantized spin-waves in ferromagnets (magnons) (Kolaf et al . , 
2012). However, any other baths unaccounted for by the model, as well as deviations 
from the weak-coupling dynamics assumed here may restore the third law. Experimental 
verification is needed to show whether the unattainability principle may indeed be broken 
or at least whether the predicted non-vanishing of the cooling speed near the absolute 
zero holds in reality. 

11.7 The Szilard-Landauer bound challenged 

Another principle that may be challenged for quantum machines is the Szilard-Landauer 
work-information tradeoff (Sec. 10). In the non-Markovian regime (Sec. 9), where the 
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Figure 21: Possible realizations of a fully quantum heat machine. Above: Coupling of a 
qubit (S') in a cavity to a piston (P) realized by mirror strain, and to two 
heat baths. Below: A superconducting qubit coupled to magnetic flux in a 
superconducting (coplanar waveguide) cavity whose mode serves as piston, 
and to two heat baths. 



Figure 22: Optomechanical realization of a quantum heat machine in a cavity setup. 
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system-bath separability fails, the proposed engine may provide more work than what was 
originally expected by Szilard-Landauer if the cycle is completed within the memory time 
of the bath. This result demonstrates the need of further investigating thermodynamic 
effects not only at the quantum level, but also in the non-Markovian regime. Besides this 
fundamental aspect, the present engine model, in which the system is always coupled to 
a single bath and yet may perform useful work, is potentially important for nanoscale 
systems totally embedded in a single bath, where conventional thermodynamic cycles 
may be impossible to implement. The model reveals the possibility of extracting work 
from changes in the system-bath quantum-correlation energy, which constitute a hitherto 
unexploited thermodynamic (work) resource. 

11.8 Open issues 

Despite the important advances in quantum thermodynamics in the recent years, certain 
fundamental questions remain still open. Below we present a short and non-exhaustive, 
list of possible future investigation paths. 

• Although many quantum heat machine models have been proposed and studied (.' 
icki, 1979; Allahverdyan and Nieuwenhuizen, 2005; Blickle and Bechinger, 2011; 
Van den Broeck, 2005; Van den Broeck et al., 2012; Campisi et al., 2011, 2009; 
Esposito et ai, 2009; Ford et al . , 1985; Ford and O’Connell, 2006; Geusic et al . , 1967; 
Geva, 2002; Jarzynski, 2007; Kieu, 2004; Lin and Chen, 2003; Linden et al, 2010; 
Quan et al., 2007; Scully et al, 2011; Talkner et al, 2007), important systems with 
inherent quantum effects, such as solar cells and photosynthesis ( lollini et al., 2010; 
Engel et al., 2007; Lee et al., 2007; Nelson, 2003; Panitchayangkoon et al., 2010; 
Wiirfel, 2009) have thus far eluded full analysis from a quantum-thermodynamic 
perspective; see recent discussion by (Alicki et ai, 2015; Finax et al., 2011). 

• Most of the quantum heat machine models assume that the working fluid interacts 
with heat reservoirs that are at thermal equilibrium. Yet, pumping by incident 
radiation or collisions, which are often treated as thermal baths, must be described 
as non-equilibrium baths. Kelvin’s formulation of the second law restricts work 
extraction to engines which operate between two equilibrium (thermal) baths, 
but is it possible to extract work from a quantum system coupled to a single 
non-equilibrium bath ? 

Among the proposed non-equilibrium baths, squeezed baths have been claimed to 
yield higher than Carnot efficiencies in a QHM, because they supply more energy 
than non-squeezed thermal baths (Abah and Lutz, 2014; Rofinagel et al., 2014). Yet, 
our non-passivity analysis suggests that such a bath may increase the non-passivity 
of the working fluid, and thus endow it with extra work rather than heat. The 
resulting efficiency is then expected to comply with the Carnot bound, because 
the extra work produced by the working fluid is compensated by the extra work 
provided by the bath. However, a more comprehensive analysis of such scenarios is 
called for, resorting to the notion of non-passivity. 
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• The controversy discussed above concerning the ability to surpass the Carnot 
bound by coupling the system (working fluid) to nonthermal baths expresses the 
present lack of consensus on the proper definition of work in quantized setups (cf. 
Sec. 11.4). The criteria for such a definition should be the possibility to convert 
it into mechanical work and its compliance with the first and second laws of 
thermodynamics. We contend that non-passivity satisfies these criteria. 

• The models described here and elsewhere assume a weak coupling between the 
system and the bath. This assumption not only simplifies the analysis, but also 
reflects the established notion that system-bath separability is essential for thermo¬ 
dynamics. On the other hand, the output of the machines is proportional to this 
coupling, hence negligible coupling renders them useless for practical applications. 
Furthermore, as shown in Sec. 9, finite coupling may have qualitative implications, 
such as the transgression of the Szilard-Landauer bound. Hence, the strong-coupling 
limit should be explored in order to find out if quantum heat machines are at all 
possible in this limit and, if so, what would be their performance bound. 

• The open issues raised above indicate that our results represent only a first step 
towards the clarification of the thermodynamic role of quantum resources, as there 
is currently no theory that addresses such issues in a general fashion. Consequently, 
the dependence of the ultimate thermodynamic bounds on quantum resources must 
be further explored. 
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